From llvm-testresults at cs.uiuc.edu Fri Jun 1 04:34:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 06:34:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601113438.58FF32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/876?compare_to=875&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 876, Order: 157810, Start Time: 2012-06-01 10:39:12, End Time: 2012-06-01 11:35:45 To: 875, Order: 157797, Start Time: 2012-06-01 05:35:20, End Time: 2012-06-01 06:32:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (49 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.75% (1.3836 => 1.4078, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/lowercase: 1.19% (7.9564 => 8.0507, std. dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.77% (2.0176 => 2.2753, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.50% (0.3130 => 0.3302, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (3.9660 => 4.0747, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9199 => 0.9416, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.6959 => 0.7121, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.32% (13.8202 => 14.1402, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 2.19% (1.0594 => 1.0826, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.99% (1.2193 => 1.2436, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1568, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.4563 => 1.4781, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4017, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (13.2842 => 13.4642, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (0.7710 => 0.7810, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.21% (1.9270 => 1.9503, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.21% (2.1791 => 2.2054, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.19% (3.8646 => 3.9107, std. dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 1.18% (16.6129 => 16.8097, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/mandel-2: 8.31% (1.2998 => 1.4078, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6921, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1226, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6975, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.70% (3.2729 => 3.3284, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9540, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1758, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0700, std. dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9327, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3650 => 0.3465, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.89% (0.3663 => 0.3484, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.84% (0.3578 => 0.3405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.40% (0.4003 => 0.3827, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.32% (0.3914 => 0.3745, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.59% (3.7467 => 3.6870, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2063, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4099, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.73% (1.9762 => 1.9025, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2278, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1572, std. dev.: 0.0198) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.58% (20.3410 => 20.0206, std. dev.: 0.0645) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1175, std. dev.: 0.0158) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8009, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6991, std. dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 09:19:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 11:19:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601161946.059BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/877?compare_to=876&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 877, Order: 157812, Start Time: 2012-06-01 15:24:23, End Time: 2012-06-01 16:20:52 To: 876, Order: 157810, Start Time: 2012-06-01 10:39:12, End Time: 2012-06-01 11:35:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (798 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2741, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.53% (0.3130 => 0.3303, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.77% (3.9660 => 4.0760, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5265 => 0.5386, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.6959 => 0.7115, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.22% (13.8202 => 14.1275, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9199 => 0.9403, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.17% (1.0594 => 1.0824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8310 => 0.8480, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.2193 => 1.2433, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.1364 => 1.1580, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.52% (1.3693 => 1.3901, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.7710 => 0.7827, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.49% (1.3245 => 1.3442, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.44% (1.4563 => 1.4772, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (13.2842 => 13.4557, std. dev.: 0.0206) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3988, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.22% (2.1791 => 2.2057, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.16% (16.6129 => 16.8064, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.15% (3.8646 => 3.9091, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.08% (1.1061 => 1.1181, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.07% (1.9270 => 1.9477, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4032, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6894, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5786, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1323, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.25% (4.5928 => 4.6963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1760, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.42% (0.4657 => 0.3613, std. dev.: 0.0319) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9321, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.01% (0.3650 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.97% (0.3623 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.89% (0.3578 => 0.3403, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.86% (0.3663 => 0.3485, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.70% (0.3940 => 0.3755, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.3914 => 0.3748, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.20% (0.4003 => 0.3835, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.59% (3.7467 => 3.6872, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (6.2785 => 6.1985, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9072, std. dev.: 0.1089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1648, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1120, std. dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7996, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (8.8259 => 8.7126, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 10:42:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 12:42:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601174223.6A1642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/878?compare_to=877&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 878, Order: 157814, Start Time: 2012-06-01 16:47:00, End Time: 2012-06-01 17:43:30 To: 877, Order: 157812, Start Time: 2012-06-01 15:24:23, End Time: 2012-06-01 16:20:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.14% (2.0176 => 2.2827, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0838, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.54% (13.8202 => 14.1712, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9199 => 0.9417, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.36% (0.5265 => 0.5389, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.27% (0.6959 => 0.7117, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.09% (1.2193 => 1.2448, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.99% (1.1364 => 1.1590, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.66% (1.3693 => 1.3920, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5010, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.4563 => 1.4798, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7038 => 0.7145, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9156, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8267, std. dev.: 0.0173) MultiSource/Applications/siod/siod: 1.28% (2.1791 => 2.2070, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.28% (1.9270 => 1.9516, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.23% (1.1061 => 1.1197, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0231, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.2742 => 3.3091, std. dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4270, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7063, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0561) SingleSource/Benchmarks/Misc/mandel-2: 8.51% (1.2998 => 1.4104, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8351, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6942, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5758, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9389, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1179, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.7000, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.27% (5.0168 => 5.0806, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2308 => 1.2437, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.61% (0.4657 => 0.3930, std. dev.: 0.0227) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9626, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.11% (0.3623 => 0.3438, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.86% (0.3663 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -4.72% (0.3940 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.37% (0.4003 => 0.3828, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -4.34% (0.3914 => 0.3744, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.83% (0.6576 => 0.6390, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.37% (3.7467 => 3.6952, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2117, std. dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5013, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1638, std. dev.: 0.0218) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0020, std. dev.: 0.0309) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.62% (8.8259 => 8.6831, std. dev.: 0.0208) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1158, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8009, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 12:05:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 14:05:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601190522.AB8762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/879?compare_to=878&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 879, Order: 157819, Start Time: 2012-06-01 18:09:43, End Time: 2012-06-01 19:06:29 To: 878, Order: 157814, Start Time: 2012-06-01 16:47:00, End Time: 2012-06-01 17:43:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (796 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7789 => 3.8461, std. dev.: 0.0231) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2740, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.80% (3.9660 => 4.0771, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.6959 => 0.7142, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (1.3245 => 1.3572, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.14% (1.2193 => 1.2454, std. dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 2.11% (13.8202 => 14.1116, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5249, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.60% (2.1791 => 2.2140, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3907, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.47% (0.7710 => 0.7823, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9545, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.37% (3.8646 => 3.9175, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4662, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.23% (1.1061 => 1.1197, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3973, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.06% (14.8535 => 15.0114, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7027, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0230) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5764, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1226, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6972, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.93% (3.7731 => 3.8461, std. dev.: 0.0231) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.61% (0.4657 => 0.3697, std. dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.49% (22.5627 => 20.8717, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3650 => 0.3475, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.69% (0.3601 => 0.3432, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.69% (0.3623 => 0.3453, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -4.58% (0.3646 => 0.3479, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.57% (0.3940 => 0.3760, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.56% (0.3663 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.48% (0.6576 => 0.6347, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.00% (0.9108 => 0.8926, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.21% (3.7467 => 3.7013, std. dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2127, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8868, std. dev.: 0.0841) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2302, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0656, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.57% (9.3358 => 9.1895, std. dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8009, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.26% (8.8259 => 8.7146, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 13:28:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 15:28:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601202807.B759A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/880?compare_to=879&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 880, Order: 157826, Start Time: 2012-06-01 19:32:42, End Time: 2012-06-01 20:29:14 To: 879, Order: 157819, Start Time: 2012-06-01 18:09:43, End Time: 2012-06-01 19:06:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.34% (3.8461 => 3.7560, std. dev.: 0.0273) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.35% (2.0176 => 2.2667, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (3.9660 => 4.0710, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.0594 => 1.0856, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.26% (0.5265 => 0.5384, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.10% (0.6959 => 0.7105, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.3245 => 1.3517, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.05% (13.8202 => 14.1033, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.79% (1.2193 => 1.2411, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.74% (1.1364 => 1.1562, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4920, std. dev.: 0.0182) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4013, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.4563 => 1.4759, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (0.7710 => 0.7813, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.33% (1.3813 => 1.3997, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.25% (2.1791 => 2.2063, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 1.16% (1.9270 => 1.9493, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.08% (1.1061 => 1.1181, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.03% (3.8646 => 3.9043, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4275, std. dev.: 0.0217) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0492) SingleSource/Benchmarks/Misc/mandel-2: 8.14% (1.2998 => 1.4056, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.77% (1.7688 => 1.8355, std. dev.: 0.0254) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7019, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4523, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5754, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1105, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.22% (4.5928 => 4.6946, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0095) MultiSource/Benchmarks/sim/sim: 1.29% (5.0168 => 5.0817, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.22% (2.0200 => 2.0447, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.28% (0.4657 => 0.3759, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.89% (22.5627 => 20.7834, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3623 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.23% (0.3663 => 0.3508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3646 => 0.3493, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: -3.01% (0.6250 => 0.6062, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.20% (0.9108 => 0.8908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.17% (0.5748 => 0.5623, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.05% (0.5818 => 0.5699, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7061 => 0.6942, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.49% (3.7467 => 3.6910, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.35% (1.9828 => 1.9561, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (6.2785 => 6.1995, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (4.9865 => 4.9293, std. dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4984, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1604, std. dev.: 0.0392) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2396, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9778, std. dev.: 0.0524) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1113, std. dev.: 0.0324) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8022, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6952, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 14:50:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 16:50:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601215057.7E9012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/881?compare_to=880&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 881, Order: 157833, Start Time: 2012-06-01 20:55:30, End Time: 2012-06-01 21:52:04 To: 880, Order: 157826, Start Time: 2012-06-01 19:32:42, End Time: 2012-06-01 20:29:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (58 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.99% (1.0967 => 1.1734, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0320 => 1.0564, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2730, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (3.9660 => 4.0812, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1513, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.22% (1.3245 => 1.3539, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.2193 => 1.2437, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.97% (1.1364 => 1.1588, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.92% (2.1791 => 2.2210, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4996, std. dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.58% (16.6129 => 16.8754, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.58% (3.8646 => 3.9255, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4024, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.4563 => 1.4783, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.46% (1.1061 => 1.1223, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4397, std. dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0530) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4036, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.0895 => 1.1734, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6904, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1373, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.5928 => 4.6966, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.32% (0.8239 => 0.8348, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.00% (5.0168 => 5.0672, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8851, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.55% (0.3511 => 0.3281, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3623 => 0.3450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.77% (0.3650 => 0.3476, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3601 => 0.3433, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: -4.64% (0.3663 => 0.3493, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -4.06% (0.3914 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4003 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.39% (0.6576 => 0.6353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.37% (0.6250 => 0.6102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.21% (0.5748 => 0.5621, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.03% (0.9108 => 0.8923, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -1.89% (0.5818 => 0.5708, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.64% (0.7061 => 0.6945, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (6.2785 => 6.1990, std. dev.: 0.0086) MultiSource/Applications/lua/lua: -1.17% (3.7467 => 3.7030, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.37% (6.3560 => 6.2053, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1501, std. dev.: 0.0620) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9704, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1069, std. dev.: 0.0208) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8002, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.34% (8.8259 => 8.7078, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.06% (2.5254 => 2.4986, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 17:01:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 19:01:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602000145.DE4032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/882?compare_to=881&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 882, Order: 157847, Start Time: 2012-06-01 23:06:23, End Time: 2012-06-02 00:02:53 To: 881, Order: 157833, Start Time: 2012-06-01 20:55:30, End Time: 2012-06-01 21:52:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (787 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9601 => 8.0599, std. dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2761, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (3.9660 => 4.0869, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9199 => 0.9462, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (1.3245 => 1.3587, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.42% (13.8202 => 14.1547, std. dev.: 0.0118) MultiSource/Applications/siod/siod: 2.37% (2.1791 => 2.2307, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2468, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1618, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5405, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9162, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.78% (3.8646 => 3.9333, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9610, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4057, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.71% (1.1061 => 1.1250, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.4563 => 1.4808, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5026, std. dev.: 0.0176) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (0.7710 => 0.7821, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0308, std. dev.: 0.0082) MultiSource/Applications/hbd/hbd: 1.18% (1.3693 => 1.3855, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.15% (1.8175 => 2.2746, std. dev.: 0.0199) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4019, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.69% (1.0895 => 1.1733, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6912, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9389, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6975, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1053, std. dev.: 0.0229) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3292, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1795, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0734, std. dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.99% (0.4657 => 0.3819, std. dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.30% (22.5627 => 20.9145, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.47% (0.3623 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.45% (0.3650 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.39% (0.3601 => 0.3407, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.30% (0.3663 => 0.3469, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.23% (0.3578 => 0.3391, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3646 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.95% (0.3940 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.86% (0.3789 => 0.3605, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.73% (0.3914 => 0.3729, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.57% (0.4003 => 0.3820, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.37% (0.5748 => 0.5612, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.03% (0.5818 => 0.5700, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.74% (0.7061 => 0.6938, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (6.2785 => 6.2022, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.12% (1.9828 => 1.9605, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2139, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1536, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1122, std. dev.: 0.0288) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8003, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0587, std. dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.30% (8.8259 => 8.7115, std. dev.: 0.0196) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 18:24:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 20:24:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602012431.0AF7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/883?compare_to=882&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 883, Order: 157860, Start Time: 2012-06-02 00:29:07, End Time: 2012-06-02 01:25:38 To: 882, Order: 157847, Start Time: 2012-06-01 23:06:23, End Time: 2012-06-02 00:02:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2895, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1000, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 2.82% (13.8202 => 14.2096, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2313, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5751, std. dev.: 0.0081) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9652, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9308, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5206, std. dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4032, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.53% (16.6129 => 16.8679, std. dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7038 => 0.7145, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.38% (1.3693 => 1.3882, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.35% (3.6692 => 3.7188, std. dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0447, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3073, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.72% (1.0895 => 1.1736, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6928, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1134, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.25% (4.5928 => 4.6961, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.71% (3.2729 => 3.3290, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0076) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.24% (1.2308 => 1.2461, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.58% (0.4657 => 0.3745, std. dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9221, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.31% (0.5748 => 0.5615, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.05% (0.5818 => 0.5699, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7061 => 0.6942, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1627, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9995, std. dev.: 0.0718) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8022, std. dev.: 0.0021) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1254, std. dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7004, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0154) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 1 19:47:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 21:47:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602024714.A1A3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/884?compare_to=883&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 884, Order: 157874, Start Time: 2012-06-02 01:51:48, End Time: 2012-06-02 02:48:20 To: 883, Order: 157860, Start Time: 2012-06-02 00:29:07, End Time: 2012-06-02 01:25:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.32% (1.3990 => 1.4174, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.12% (1.2461 => 1.2322, std. dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2744, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0885, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.9199 => 0.9468, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.74% (1.3245 => 1.3608, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1647, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.31% (2.1791 => 2.2294, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8646 => 3.9394, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5387, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.71% (1.9270 => 1.9599, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.71% (16.6129 => 16.8963, std. dev.: 0.0106) MultiSource/Applications/Burg/burg: 1.69% (1.1061 => 1.1248, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4732, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0192, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.00% (3.6692 => 3.7059, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.0895 => 1.1734, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6958, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1270, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6977, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3291, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std. dev.: 0.0157) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.38% (22.5627 => 20.8975, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.05% (0.3623 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.97% (0.3663 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.86% (0.3578 => 0.3404, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.59% (0.3940 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.54% (0.3789 => 0.3617, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.22% (0.4003 => 0.3834, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (6.2785 => 6.2142, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2285, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9350, std. dev.: 0.0221) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.61% (9.3358 => 9.1857, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8562, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6897, std. dev.: 0.0125) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1114, std. dev.: 0.0160) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8011, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 02:30:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 04:30:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602093033.67F1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/885?compare_to=884&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 885, Order: 157882, Start Time: 2012-06-02 08:34:52, End Time: 2012-06-02 09:31:40 To: 884, Order: 157874, Start Time: 2012-06-02 01:51:48, End Time: 2012-06-02 02:48:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2743, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (3.9660 => 4.0907, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9199 => 0.9484, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.80% (1.3245 => 1.3616, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1823, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2302, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1618, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4868, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.06% (16.6129 => 16.9549, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5462, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9372, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9622, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.71% (1.3813 => 1.4049, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4031, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4814, std. dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0269, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (3.6692 => 3.7080, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2511, std. dev.: 0.0490) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.0895 => 1.1734, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7009, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5778, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1308, std. dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6986, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3301, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9098, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.61% (0.3578 => 0.3413, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.55% (0.3601 => 0.3437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.53% (0.3663 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4003 => 0.3847, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -1.79% (0.5748 => 0.5645, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1601, std. dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9609, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8570, std. dev.: 0.0182) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1102, std. dev.: 0.0292) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.53% (8.8259 => 8.6912, std. dev.: 0.0196) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8007, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 03:53:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 05:53:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602105330.6A5302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/886?compare_to=885&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 886, Order: 157883, Start Time: 2012-06-02 09:57:57, End Time: 2012-06-02 10:54:38 To: 885, Order: 157882, Start Time: 2012-06-02 08:34:52, End Time: 2012-06-02 09:31:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2740, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (3.9660 => 4.0861, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9199 => 0.9471, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.69% (1.3245 => 1.3601, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1521, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.2193 => 1.2471, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2255, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7710 => 0.7856, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (13.2842 => 13.5158, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (3.8646 => 3.9313, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 1.72% (16.6129 => 16.8989, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4804, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.59% (1.9270 => 1.9576, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.56% (0.7038 => 0.7148, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4018, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.46% (1.3819 => 1.4021, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4675, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0147, std. dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std. dev.: 0.0281) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.71% (1.0895 => 1.1735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.13% (1.2998 => 1.3925, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.13% (7.9275 => 8.0964, std. dev.: 0.0202) MultiSource/Applications/siod/siod: 1.70% (3.2729 => 3.3287, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.08% (1.9290 => 1.9499, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.57% (0.4657 => 0.4118, std. dev.: 0.0153) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9033, std. dev.: 0.1107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -5.05% (0.3623 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.93% (0.3650 => 0.3470, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.86% (0.3578 => 0.3404, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.57% (0.3940 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.35% (0.3789 => 0.3624, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -4.32% (0.3914 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.25% (0.4003 => 0.3833, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.6576 => 0.6416, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.76% (0.5748 => 0.5647, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (6.2785 => 6.2148, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (20.3410 => 19.8560, std. dev.: 0.0904) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2314, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1559, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8016, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1377, std. dev.: 0.0205) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7002, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 05:16:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 07:16:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602121639.A09722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/887?compare_to=886&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 887, Order: 157886, Start Time: 2012-06-02 11:21:04, End Time: 2012-06-02 12:17:47 To: 886, Order: 157883, Start Time: 2012-06-02 09:57:57, End Time: 2012-06-02 10:54:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.06% (1.3925 => 1.4073, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (3.9660 => 4.0981, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.63% (1.3245 => 1.3593, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1825, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2275, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9365, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9121, std. dev.: 0.0172) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5201, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (0.7710 => 0.7844, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.73% (1.3819 => 1.4058, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.3813 => 1.4042, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0197, std. dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4418, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3075, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0514) SingleSource/Benchmarks/Misc/mandel-2: 8.27% (1.2998 => 1.4073, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.71% (1.0895 => 1.1735, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6874, std. dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1266, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6969, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.71% (3.2729 => 3.3290, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0763, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.10% (0.4657 => 0.4233, std. dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9371, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.95% (0.3646 => 0.3502, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3650 => 0.3508, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.32% (0.6576 => 0.6358, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.11% (2.5089 => 2.4057, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2232, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1499, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5127, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8005, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0389, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0213) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1246, std. dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.34% (8.8259 => 8.7079, std. dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 08:14:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 10:14:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602151422.92A452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/888?compare_to=887&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 888, Order: 157887, Start Time: 2012-06-02 14:18:50, End Time: 2012-06-02 15:15:29 To: 887, Order: 157886, Start Time: 2012-06-02 11:21:04, End Time: 2012-06-02 12:17:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.94% (3.8460 => 3.7715, std. dev.: 0.0219) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0880, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.6959 => 0.7154, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.57% (1.3245 => 1.3586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1514, std. dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 1.76% (16.6129 => 16.9052, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.4563 => 1.4812, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9287, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5043, std. dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9573, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4017, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4414, std. dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 1.08% (1.2749 => 1.2887, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0139, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.00% (3.6692 => 3.7059, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std. dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.71% (1.0895 => 1.1735, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6984, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.02% (12.0921 => 12.4570, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1141, std. dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6976, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3304, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5069, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9647, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9310, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.53% (0.6576 => 0.6344, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (0.9108 => 0.8951, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2160, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4968, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9375, std. dev.: 0.0327) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1597, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8035, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1427, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.24% (8.8259 => 8.7162, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 09:37:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 11:37:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602163700.AC8882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/889?compare_to=888&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 889, Order: 157888, Start Time: 2012-06-02 15:41:39, End Time: 2012-06-02 16:38:08 To: 888, Order: 157887, Start Time: 2012-06-02 14:18:50, End Time: 2012-06-02 15:15:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.40% (0.4067 => 0.3644, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2664, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0833, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.6959 => 0.7150, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.40% (1.3245 => 1.3563, std. dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1463, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.00% (1.1364 => 1.1591, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2208, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.4563 => 1.4841, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 1.64% (1.1061 => 1.1242, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9274, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (13.2842 => 13.4977, std. dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8786, std. dev.: 0.0220) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.52% (1.9270 => 1.9563, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4027, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3996, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.05% (1.3693 => 1.3837, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.05% (16.2614 => 16.4321, std. dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2516, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.71% (1.0895 => 1.1735, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6845, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5786, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1265, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6972, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3291, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0838, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.09% (1.9433 => 1.9645, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.08% (9.0760 => 9.1743, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.5627 => 20.9188, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.26% (0.3940 => 0.3772, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.87% (0.4003 => 0.3848, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.41% (0.6576 => 0.6352, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.50% (0.6250 => 0.6094, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.90% (0.9108 => 0.8935, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.06% (3.7467 => 3.7071, std. dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1511, std. dev.: 0.0347) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9391, std. dev.: 0.0253) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5118, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7981, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1176, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6957, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 10:59:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 12:59:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602175956.715ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/890?compare_to=889&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 890, Order: 157891, Start Time: 2012-06-02 17:04:25, End Time: 2012-06-02 18:01:03 To: 889, Order: 157888, Start Time: 2012-06-02 15:41:39, End Time: 2012-06-02 16:38:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2650, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (3.9660 => 4.0773, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.0594 => 1.0875, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5265 => 0.5395, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (1.3245 => 1.3549, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.23% (13.8202 => 14.1280, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2196, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 1.62% (3.8646 => 3.9271, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.55% (1.4563 => 1.4788, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.52% (1.1061 => 1.1229, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4839, std. dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.50% (16.6129 => 16.8614, std. dev.: 0.0119) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9544, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.3813 => 1.4005, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4629, std. dev.: 0.0307) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3861, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0076, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.0895 => 1.1734, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3994, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6957, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1072, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.21% (4.5928 => 4.6944, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3302, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.07% (5.0168 => 5.0705, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.72% (0.4657 => 0.3832, std. dev.: 0.0281) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8842, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.21% (0.6576 => 0.6365, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: -2.53% (0.6250 => 0.6092, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.5748 => 0.5641, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -1.75% (0.5818 => 0.5716, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.11% (3.7467 => 3.7050, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.51% (6.3560 => 6.1966, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1532, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9664, std. dev.: 0.0287) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1185, std. dev.: 0.0143) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8006, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7007, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 12:33:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 14:33:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602193348.EC0612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/891?compare_to=890&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 891, Order: 157892, Start Time: 2012-06-02 18:38:33, End Time: 2012-06-02 19:34:56 To: 890, Order: 157891, Start Time: 2012-06-02 17:04:25, End Time: 2012-06-02 18:01:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.16% (7.9507 => 8.0429, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.28% (2.0176 => 2.2653, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.94% (0.9199 => 0.9469, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (3.9660 => 4.0811, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.6959 => 0.7153, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.0594 => 1.0873, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.3245 => 1.3566, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.26% (13.8202 => 14.1322, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.15% (1.2193 => 1.2455, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.65% (3.8646 => 3.9283, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.59% (1.1061 => 1.1237, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4791, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.53% (16.6129 => 16.8669, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4866, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.15% (1.3693 => 1.3851, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4298, std. dev.: 0.0261) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2529, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.0895 => 1.1734, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3967, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6949, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1227, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6986, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.66% (3.2729 => 3.3272, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.47% (0.4657 => 0.3657, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.43% (22.5627 => 20.8857, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.75% (0.6576 => 0.6395, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.79% (0.5748 => 0.5645, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.5818 => 0.5718, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.11% (3.7467 => 3.7051, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2200, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1561, std. dev.: 0.0395) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9502, std. dev.: 0.0456) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1041, std. dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8004, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.30% (8.8259 => 8.7108, std. dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 13:56:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 15:56:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120602205635.8D74B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/892?compare_to=891&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 892, Order: 157893, Start Time: 2012-06-02 20:01:13, End Time: 2012-06-02 20:57:42 To: 891, Order: 157892, Start Time: 2012-06-02 18:38:33, End Time: 2012-06-02 19:34:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.25% (2.0176 => 2.2648, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0830, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.0594 => 1.0863, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.3245 => 1.3564, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1355, std. dev.: 0.0153) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.2193 => 1.2442, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.03% (1.1364 => 1.1595, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2215, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9277, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 1.58% (1.9270 => 1.9574, std. dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.2842 => 13.4809, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 1.47% (16.6129 => 16.8571, std. dev.: 0.0277) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4005, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.33% (1.3813 => 1.3997, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.16% (1.3693 => 1.3852, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.01% (16.2614 => 16.4260, std. dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2501, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.71% (1.0895 => 1.1735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.41% (1.2998 => 1.3961, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6946, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1347, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.25% (4.5928 => 4.6963, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0757, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 1.09% (1.9290 => 1.9500, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.5627 => 20.8928, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.40% (0.4003 => 0.3867, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -1.84% (0.5748 => 0.5642, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.11% (3.7467 => 3.7052, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2166, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9738, std. dev.: 0.0303) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1676, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.52% (8.8259 => 8.6914, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7993, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1359, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0148) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 19:00:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 21:00:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603020022.E40982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/893?compare_to=892&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 893, Order: 157894, Start Time: 2012-06-03 01:04:51, End Time: 2012-06-03 02:01:29 To: 892, Order: 157893, Start Time: 2012-06-02 20:01:13, End Time: 2012-06-02 20:57:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.45% (3.8571 => 3.7627, std. dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.25% (2.0176 => 2.2648, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0836, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.88% (0.9199 => 0.9464, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.0594 => 1.0880, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.48% (1.3245 => 1.3573, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1559, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.7710 => 0.7893, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2458, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.99% (1.1364 => 1.1590, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2208, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 1.66% (16.6129 => 16.8895, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9261, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 1.58% (1.1061 => 1.1236, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4859, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.49% (1.9270 => 1.9557, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.3813 => 1.4005, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.24% (1.3693 => 1.3863, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std. dev.: 0.0391) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4084, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.72% (1.0895 => 1.1736, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6965, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1298, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.81% (3.2729 => 3.3322, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.09% (1.9433 => 1.9645, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8834, std. dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3578 => 0.3439, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.80% (0.3601 => 0.3464, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.42% (0.4003 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.6576 => 0.6369, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.84% (0.5748 => 0.5642, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0063) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7045, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9512, std. dev.: 0.0349) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1608, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2399, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6901, std. dev.: 0.0097) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1094, std. dev.: 0.0414) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8038, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8460, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 20:23:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 22:23:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603032314.5319C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/894?compare_to=893&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 894, Order: 157895, Start Time: 2012-06-03 02:27:56, End Time: 2012-06-03 03:24:21 To: 893, Order: 157894, Start Time: 2012-06-03 01:04:51, End Time: 2012-06-03 02:01:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.71% (0.4010 => 0.3701, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.38% (2.0176 => 2.2674, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0836, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0594 => 1.0876, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.3245 => 1.3579, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.25% (13.8202 => 14.1306, std. dev.: 0.0147) MultiSource/Applications/siod/siod: 2.11% (2.1791 => 2.2251, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.09% (1.2193 => 1.2448, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1364 => 1.1589, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.70% (16.6129 => 16.8951, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9298, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 1.61% (1.1061 => 1.1239, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.4563 => 1.4797, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4960, std. dev.: 0.0280) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4114, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.69% (1.0895 => 1.1733, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7300, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6977, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1044, std. dev.: 0.0108) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (1.9433 => 1.9650, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.53% (0.4657 => 0.3701, std. dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.5627 => 20.8517, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.09% (0.3623 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.74% (0.3663 => 0.3526, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4003 => 0.3870, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.12% (0.6576 => 0.6371, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.93% (0.9108 => 0.8932, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.06% (3.7467 => 3.7068, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (6.2785 => 6.2156, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2150, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1560, std. dev.: 0.0306) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9920, std. dev.: 0.0546) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8038, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1326, std. dev.: 0.0289) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.34% (8.8259 => 8.7073, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 2 21:46:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 2 Jun 2012 23:46:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603044610.A01E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/895?compare_to=894&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 895, Order: 157896, Start Time: 2012-06-03 03:50:38, End Time: 2012-06-03 04:47:17 To: 894, Order: 157895, Start Time: 2012-06-03 02:27:56, End Time: 2012-06-03 03:24:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.50% (1.1733 => 1.0970, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.31% (1.0564 => 1.0320, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0594 => 1.0916, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0829, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.68% (1.3245 => 1.3600, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1515, std. dev.: 0.0075) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2463, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1602, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5441, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 1.81% (3.8646 => 3.9346, std. dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 1.76% (16.6129 => 16.9047, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.4563 => 1.4805, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9583, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (1.3813 => 1.4030, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (0.7710 => 0.7825, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.19% (1.2749 => 1.2901, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.12% (16.2614 => 16.4441, std. dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0188, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7074, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2550, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4036, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7024, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5773, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1261, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6970, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3275, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0719, std. dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9052, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: -4.72% (0.3623 => 0.3452, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.68% (0.3650 => 0.3479, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3601 => 0.3433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.50% (0.3578 => 0.3417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4003 => 0.3847, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.08% (3.7467 => 3.7064, std. dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2138, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2111, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.81% (9.3358 => 9.1666, std. dev.: 0.0280) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9867, std. dev.: 0.0382) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8002, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0063) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1501, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (8.8259 => 8.7049, std. dev.: 0.0133) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 01:34:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 03:34:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603083429.3D8442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/896?compare_to=895&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 896, Order: 157897, Start Time: 2012-06-03 07:38:47, End Time: 2012-06-03 08:35:36 To: 895, Order: 157896, Start Time: 2012-06-03 03:50:38, End Time: 2012-06-03 04:47:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.88% (0.9199 => 0.9464, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1618, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 2.41% (2.1791 => 2.2316, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2474, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.7710 => 0.7878, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.09% (1.3693 => 1.3979, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (13.2842 => 13.5597, std. dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 2.05% (16.6129 => 16.9533, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4856, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9373, std. dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9612, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4060, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4043, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4627, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0372, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2896, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3077, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0442) SingleSource/Benchmarks/Misc/mandel-2: 6.74% (1.2998 => 1.3874, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.4271 => 7.7046, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1215, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6985, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3299, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.2308 => 1.2436, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.5627 => 20.9255, std. dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.96% (0.3789 => 0.3639, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (6.2785 => 6.2156, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.38% (6.3560 => 6.2050, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9155, std. dev.: 0.0731) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.53% (8.8259 => 8.6907, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8007, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0124) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1341, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 02:57:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 04:57:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603095725.01A3D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/897?compare_to=896&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 897, Order: 157899, Start Time: 2012-06-03 09:01:54, End Time: 2012-06-03 09:58:32 To: 896, Order: 157897, Start Time: 2012-06-03 07:38:47, End Time: 2012-06-03 08:35:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2663, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0882, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9199 => 0.9478, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (1.3245 => 1.3604, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1740, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2303, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.03% (16.6129 => 16.9503, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9365, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5303, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 1.76% (1.1061 => 1.1256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.4563 => 1.4819, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.73% (1.9270 => 1.9604, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 1.64% (1.3693 => 1.3918, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4609, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.3813 => 1.3978, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.3819 => 1.3984, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7022, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5761, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6975, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1003, std. dev.: 0.0190) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3270, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0765, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9018, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -3.97% (0.3623 => 0.3479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.95% (0.3646 => 0.3502, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3663 => 0.3519, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9431, std. dev.: 0.0456) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1532, std. dev.: 0.0172) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.55% (8.8259 => 8.6893, std. dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8023, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1235, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 04:40:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 06:40:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603114000.0AC562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/898?compare_to=897&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 898, Order: 157900, Start Time: 2012-06-03 10:44:37, End Time: 2012-06-03 11:41:09 To: 897, Order: 157899, Start Time: 2012-06-03 09:01:54, End Time: 2012-06-03 09:58:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.32% (2.0176 => 2.2661, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.9199 => 0.9481, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1627, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2326, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2474, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1601, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8646 => 3.9395, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5403, std. dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 1.92% (16.6129 => 16.9313, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.4563 => 1.4814, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.68% (1.3693 => 1.3923, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.3819 => 1.4014, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.29% (1.3813 => 1.3991, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4676, std. dev.: 0.0244) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0090, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6910, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9776, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1173, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.5928 => 4.6937, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0739, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.33% (0.4657 => 0.3757, std. dev.: 0.0291) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.5627 => 20.8925, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.6576 => 0.6375, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -2.16% (0.6250 => 0.6115, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.90% (0.9108 => 0.8935, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4065, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9347, std. dev.: 0.0426) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2311, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.75% (9.3358 => 9.1721, std. dev.: 0.0286) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1148, std. dev.: 0.0239) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8011, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6955, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 10:10:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 12:10:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603171014.B83992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/899?compare_to=898&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 899, Order: 157901, Start Time: 2012-06-03 16:14:51, End Time: 2012-06-03 17:11:23 To: 898, Order: 157900, Start Time: 2012-06-03 10:44:37, End Time: 2012-06-03 11:41:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0594 => 1.0936, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9199 => 0.9482, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3245 => 1.3620, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.42% (13.8202 => 14.1550, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.2193 => 1.2483, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.1364 => 1.1624, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4867, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5449, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.76% (1.1061 => 1.1256, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (3.8646 => 3.9324, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 1.70% (16.6129 => 16.8945, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (3.2742 => 3.3206, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4619, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7135, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3975, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0257, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.09% (1.3819 => 1.3970, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6983, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1163, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6977, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2455, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1790, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.60% (0.2670 => 0.2467, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8758, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3650 => 0.3493, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.16% (0.3578 => 0.3429, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.5748 => 0.5641, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2276, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9748, std. dev.: 0.0233) MultiSource/Applications/minisat/minisat: -1.67% (9.3358 => 9.1799, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8026, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1221, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7065, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 11:32:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 13:32:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603183256.8FF182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/900?compare_to=899&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 900, Order: 157902, Start Time: 2012-06-03 17:37:32, End Time: 2012-06-03 18:34:05 To: 899, Order: 157901, Start Time: 2012-06-03 16:14:51, End Time: 2012-06-03 17:11:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.50% (2.0176 => 2.2900, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.54% (1.0594 => 1.0969, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1059, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.6959 => 0.7200, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3679, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8310 => 0.8570, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2164, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.81% (2.1791 => 2.2403, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1668, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.4563 => 1.4910, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.28% (1.9270 => 1.9710, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 2.21% (3.8646 => 3.9502, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5724, std. dev.: 0.0216) MultiSource/Applications/kimwitu++/kc: 2.15% (16.6129 => 16.9700, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4100, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.3819 => 1.4093, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5261, std. dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0925, std. dev.: 0.0106) MultiSource/Applications/hbd/hbd: 1.58% (1.3693 => 1.3909, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7223, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.2742 => 3.3187, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.30% (1.1333 => 1.1480, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1258, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (6.5754 => 6.6537, std. dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0524) SingleSource/Benchmarks/Misc/mandel-2: 6.86% (1.2998 => 1.3890, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6762, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6890, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (2.8606 => 2.9383, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6987, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1071, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3301, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.43% (0.4657 => 0.3659, std. dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9548, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3650 => 0.3508, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.72% (0.3578 => 0.3445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.35% (0.8818 => 0.8611, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2124, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9322, std. dev.: 0.0253) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: -1.81% (9.3358 => 9.1669, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.59% (8.8259 => 8.6856, std. dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8008, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1252, std. dev.: 0.0345) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 13:24:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 15:24:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603202432.218492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/901?compare_to=900&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 901, Order: 157903, Start Time: 2012-06-03 19:29:06, End Time: 2012-06-03 20:25:41 To: 900, Order: 157902, Start Time: 2012-06-03 17:37:32, End Time: 2012-06-03 18:34:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (61 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.04% (1.3890 => 1.4034, std. dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2896, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1081, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.0594 => 1.0967, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3683, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.10% (0.8310 => 0.8568, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.02% (13.8202 => 14.2372, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2393, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.2193 => 1.2526, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.4563 => 1.4910, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (3.8646 => 3.9543, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.28% (1.9270 => 1.9710, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5787, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: 2.19% (1.1061 => 1.1303, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9691, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4114, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3907, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.55% (14.8535 => 15.0843, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5016, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7216, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.2742 => 3.3181, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6540, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.1007 => 2.1252, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2532, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.97% (1.2998 => 1.4034, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5766, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.71% (2.8606 => 2.9382, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6976, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1058, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0388) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.71% (0.4657 => 0.3646, std. dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9590, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3650 => 0.3508, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.6576 => 0.6406, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.19% (0.8818 => 0.8625, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2119, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1514, std. dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9461, std. dev.: 0.0399) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5132, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.75% (8.8259 => 8.6714, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8568, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1189, std. dev.: 0.0305) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8013, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 16:13:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 18:13:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120603231355.F27DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/902?compare_to=901&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 902, Order: 157904, Start Time: 2012-06-03 22:18:37, End Time: 2012-06-03 23:15:04 To: 901, Order: 157903, Start Time: 2012-06-03 19:29:06, End Time: 2012-06-03 20:25:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2716, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.6959 => 0.7190, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (3.9660 => 4.0950, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.92% (1.3819 => 1.4222, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.71% (1.3813 => 1.4188, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1784, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2327, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5577 => 0.5710, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.7710 => 0.7888, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.11% (3.8646 => 3.9462, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5576, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9659, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.94% (16.6129 => 16.9353, std. dev.: 0.0171) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.85% (1.3693 => 1.3947, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4817, std. dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0435, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6692 => 3.7127, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0250) SingleSource/Benchmarks/Misc/mandel-2: 9.20% (1.2998 => 1.4194, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6981, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8321, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (2.8606 => 2.9383, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1243, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.32% (4.5928 => 4.6995, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3301, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.63% (0.8273 => 0.8408, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.30% (0.8239 => 0.8346, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.28% (0.4657 => 0.3666, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9332, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.6576 => 0.6363, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2209, std. dev.: 0.0136) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4983, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9483, std. dev.: 0.0436) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1641, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.59% (8.8259 => 8.6858, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8009, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1287, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 17:36:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 19:36:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604003625.C44C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/903?compare_to=902&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 903, Order: 157908, Start Time: 2012-06-03 23:41:11, End Time: 2012-06-04 00:37:34 To: 902, Order: 157904, Start Time: 2012-06-03 22:18:37, End Time: 2012-06-03 23:15:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.18% (1.4194 => 1.4026, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2749, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0953, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9199 => 0.9495, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.95% (1.3813 => 1.4220, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1600, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.1364 => 1.1640, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.19% (1.4563 => 1.4882, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.2842 => 13.5562, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9420, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9653, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.97% (1.3693 => 1.3963, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.93% (16.6129 => 16.9343, std. dev.: 0.0172) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (0.7460 => 0.7591, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4811, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0410, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7116, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std. dev.: 0.0321) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6959, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5773, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.73% (2.8606 => 2.9387, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1153, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.5928 => 4.6968, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3303, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.30% (5.0168 => 5.0819, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.33% (0.4657 => 0.3617, std. dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9207, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3663 => 0.3519, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.81% (0.5748 => 0.5644, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.73% (1.9762 => 1.9025, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1526, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5126, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9944, std. dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.67% (8.8259 => 8.6781, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1135, std. dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8002, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0150) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 18:58:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 20:58:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604015854.ABDE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/904?compare_to=903&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 904, Order: 157910, Start Time: 2012-06-04 01:03:40, End Time: 2012-06-04 02:00:03 To: 903, Order: 157908, Start Time: 2012-06-03 23:41:11, End Time: 2012-06-04 00:37:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.07% (1.9764 => 1.9552, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2797, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1004, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.9199 => 0.9510, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2376, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1732, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5748, std. dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9475, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.97% (16.6129 => 16.9405, std. dev.: 0.0254) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (0.7038 => 0.7168, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5091, std. dev.: 0.0258) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0411, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7112, std. dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1333 => 1.1453, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6429, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2588, std. dev.: 0.0435) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3980, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7036, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4525, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6976, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1003, std. dev.: 0.0116) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2308 => 1.2440, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0687, std. dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.44% (0.4657 => 0.3612, std. dev.: 0.0201) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9439, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.88% (0.3650 => 0.3472, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.86% (0.3623 => 0.3447, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3663 => 0.3486, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3578 => 0.3409, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: -4.11% (0.3914 => 0.3753, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.88% (0.8818 => 0.8564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.85% (0.6250 => 0.6072, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -2.12% (0.5748 => 0.5626, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -1.82% (0.5818 => 0.5712, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.56% (0.7061 => 0.6951, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (1.9828 => 1.9552, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3030, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.17% (20.3410 => 19.8989, std. dev.: 0.0644) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2246, std. dev.: 0.0106) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1585, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.0988, std. dev.: 0.0452) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8001, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.23% (8.8259 => 8.7173, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 20:50:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 3 Jun 2012 22:50:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604035012.2FBC22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/905?compare_to=904&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 905, Order: 157911, Start Time: 2012-06-04 02:54:45, End Time: 2012-06-04 03:51:20 To: 904, Order: 157910, Start Time: 2012-06-04 01:03:40, End Time: 2012-06-04 02:00:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2785, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.6959 => 0.7204, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0962, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3648, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.67% (2.1791 => 2.2373, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1743, std. dev.: 0.0179) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9495, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5738, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.11% (1.1061 => 1.1294, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (1.3813 => 1.4092, std. dev.: 0.0065) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9659, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.99% (16.6129 => 16.9437, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.97% (1.3819 => 1.4091, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7710 => 0.7856, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.53% (16.2614 => 16.5099, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0427, std. dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (6.5754 => 6.6553, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7099, std. dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2890, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1333 => 1.1452, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.89% (1.8175 => 2.2517, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel-2: 8.10% (1.2998 => 1.4051, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6967, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5783, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1294, std. dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9443, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.61% (0.3511 => 0.3279, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.05% (0.3623 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.91% (0.3646 => 0.3467, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.89% (0.3663 => 0.3484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.84% (0.3578 => 0.3405, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.15% (0.4003 => 0.3837, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -2.86% (0.6250 => 0.6071, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.23% (0.5748 => 0.5620, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -1.87% (0.5818 => 0.5709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.56% (0.7061 => 0.6951, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.32% (1.9828 => 1.9567, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2134, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1576, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9775, std. dev.: 0.0606) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.66% (8.8259 => 8.6792, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.59% (26.5159 => 26.0953, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8040, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 3 22:12:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 00:12:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604051237.381EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/906?compare_to=905&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 906, Order: 157913, Start Time: 2012-06-04 04:17:22, End Time: 2012-06-04 05:13:46 To: 905, Order: 157911, Start Time: 2012-06-04 02:54:45, End Time: 2012-06-04 03:51:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (785 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (3.9660 => 4.0980, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (1.3245 => 1.3649, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2406, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 2.64% (13.8202 => 14.1852, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.4563 => 1.4885, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5773, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9495, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.06% (1.9270 => 1.9666, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4091, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.94% (16.6129 => 16.9358, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5038, std. dev.: 0.0246) MultiSource/Applications/hbd/hbd: 1.45% (1.3693 => 1.3892, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0412, std. dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7094, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6926, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1091, std. dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.5928 => 4.6964, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.68% (3.2729 => 3.3280, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5108, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1803, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0722, std. dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.65% (0.4657 => 0.3602, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9513, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.08% (0.3623 => 0.3439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -4.91% (0.3646 => 0.3467, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.81% (0.3578 => 0.3406, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.54% (0.3789 => 0.3617, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.12% (0.4003 => 0.3838, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.83% (0.6250 => 0.6073, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.6576 => 0.6402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.14% (0.5748 => 0.5625, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.87% (0.5818 => 0.5709, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.56% (0.7061 => 0.6951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (1.9828 => 1.9553, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.51% (6.3560 => 6.1966, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1521, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9741, std. dev.: 0.0568) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1017, std. dev.: 0.0408) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7998, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7033, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 01:34:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 03:34:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604083447.1511D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/907?compare_to=906&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 907, Order: 157914, Start Time: 2012-06-04 07:39:09, End Time: 2012-06-04 08:35:55 To: 906, Order: 157913, Start Time: 2012-06-04 04:17:22, End Time: 2012-06-04 05:13:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.6959 => 0.7190, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (3.9660 => 4.0945, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.56% (2.1791 => 2.2349, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1616, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.2193 => 1.2478, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9454, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5435, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 1.93% (16.6129 => 16.9339, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (1.3819 => 1.4084, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9637, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.3813 => 1.4056, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4711, std. dev.: 0.0149) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0449, std. dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7074, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2656, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7032, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4532, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5777, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1236, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6984, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3303, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0764, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9087, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.61% (0.3511 => 0.3279, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.19% (0.3623 => 0.3435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3650 => 0.3464, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -5.05% (0.3601 => 0.3419, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.00% (0.3663 => 0.3480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.97% (0.3578 => 0.3400, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.91% (0.3646 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.62% (0.3940 => 0.3758, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.34% (0.3914 => 0.3744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.22% (0.4003 => 0.3834, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.96% (0.6250 => 0.6065, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.6576 => 0.6401, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -2.28% (0.5748 => 0.5617, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.01% (0.5818 => 0.5701, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.76% (0.7061 => 0.6937, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.48% (1.9828 => 1.9535, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (6.2785 => 6.2149, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9007, std. dev.: 0.0501) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2311, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0152) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5123, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1194, std. dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8010, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.30% (8.8259 => 8.7113, std. dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 02:57:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 04:57:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604095737.108BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/908?compare_to=907&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 908, Order: 157917, Start Time: 2012-06-04 09:02:10, End Time: 2012-06-04 09:58:45 To: 907, Order: 157914, Start Time: 2012-06-04 07:39:09, End Time: 2012-06-04 08:35:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2857, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0974, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9199 => 0.9499, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1781, std. dev.: 0.0141) MultiSource/Applications/siod/siod: 2.51% (2.1791 => 2.2337, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.1364 => 1.1636, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (3.8646 => 3.9440, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5556, std. dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 2.02% (16.6129 => 16.9478, std. dev.: 0.0129) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.7710 => 0.7846, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.66% (1.3693 => 1.3920, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3813 => 1.4037, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.3819 => 1.4029, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4979, std. dev.: 0.0220) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0410, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7073, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2564, std. dev.: 0.0406) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6886, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1310, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6971, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3299, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.38% (5.0168 => 5.0859, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1748, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.07% (0.4657 => 0.3769, std. dev.: 0.0299) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9219, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.97% (0.3623 => 0.3443, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.85% (0.3650 => 0.3473, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3601 => 0.3428, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3663 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3646 => 0.3474, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.38% (0.3789 => 0.3623, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.34% (0.3940 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.10% (0.4003 => 0.3839, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.58% (0.6250 => 0.6089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.74% (0.5748 => 0.5648, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (0.9108 => 0.8951, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (20.3410 => 19.8550, std. dev.: 0.0989) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2325, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1565, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.60% (26.5159 => 26.0914, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8001, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7002, std. dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 04:24:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 06:24:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604112415.88FDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/909?compare_to=908&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 909, Order: 157920, Start Time: 2012-06-04 10:28:51, End Time: 2012-06-04 11:25:25 To: 908, Order: 157917, Start Time: 2012-06-04 09:02:10, End Time: 2012-06-04 09:58:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.21% (7.9504 => 8.0469, std. dev.: 0.0191) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.21% (2.0176 => 2.2841, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.29% (3.9660 => 4.0966, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.22% (0.6959 => 0.7183, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5265 => 0.5417, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1836, std. dev.: 0.0125) MultiSource/Applications/siod/siod: 2.51% (2.1791 => 2.2338, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.2193 => 1.2482, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4870, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (3.8646 => 3.9446, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5576, std. dev.: 0.0202) MultiSource/Applications/kimwitu++/kc: 2.06% (16.6129 => 16.9543, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 2.00% (1.1061 => 1.1282, std. dev.: 0.0074) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9652, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4045, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.58% (1.3813 => 1.4031, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.46% (16.2614 => 16.4983, std. dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0322, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7120, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1333 => 1.1450, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3074, std. dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2608, std. dev.: 0.0524) SingleSource/Benchmarks/Misc/mandel-2: 7.77% (1.2998 => 1.4008, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6893, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1160, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6988, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.71% (3.2729 => 3.3288, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.34% (22.5627 => 20.9055, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.72% (0.3511 => 0.3275, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.97% (0.3623 => 0.3443, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.93% (0.3650 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.89% (0.3601 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3663 => 0.3489, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.61% (0.3578 => 0.3413, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.43% (0.3789 => 0.3621, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.3914 => 0.3750, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.07% (0.4003 => 0.3840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.8818 => 0.8561, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -1.90% (0.5748 => 0.5639, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (6.2785 => 6.2152, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4102, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2205, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1579, std. dev.: 0.0390) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9599, std. dev.: 0.0362) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5107, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7996, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6960, std. dev.: 0.0098) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1262, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 05:47:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 07:47:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604124704.797712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/910?compare_to=909&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 910, Order: 157923, Start Time: 2012-06-04 11:51:35, End Time: 2012-06-04 12:48:14 To: 909, Order: 157920, Start Time: 2012-06-04 10:28:51, End Time: 2012-06-04 11:25:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2885, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1043, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.0594 => 1.0945, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1973, std. dev.: 0.0082) MultiSource/Applications/siod/siod: 2.70% (2.1791 => 2.2380, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2193 => 1.2504, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.4563 => 1.4927, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5867, std. dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9515, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.21% (1.9270 => 1.9696, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.18% (16.6129 => 16.9743, std. dev.: 0.0223) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (0.7710 => 0.7860, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.91% (1.3813 => 1.4077, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.89% (1.3819 => 1.4080, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3906, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4933, std. dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.34% (3.6692 => 3.7183, std. dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0449, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6489, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.95% (0.4846 => 0.6976, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2685, std. dev.: 0.0439) SingleSource/Benchmarks/Misc/mandel-2: 7.51% (1.2998 => 1.3974, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5778, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6985, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1015, std. dev.: 0.0286) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: 1.37% (1.2308 => 1.2477, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.41% (0.4657 => 0.3846, std. dev.: 0.0243) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9320, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3601 => 0.3428, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.77% (0.3650 => 0.3476, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3663 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3578 => 0.3411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.30% (0.3789 => 0.3626, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.6576 => 0.6412, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5000, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1638, std. dev.: 0.0312) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9667, std. dev.: 0.0369) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1097, std. dev.: 0.0277) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8010, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6979, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 07:09:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 09:09:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604140944.7EC0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/911?compare_to=910&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 911, Order: 157925, Start Time: 2012-06-04 13:14:25, End Time: 2012-06-04 14:10:54 To: 910, Order: 157923, Start Time: 2012-06-04 11:51:35, End Time: 2012-06-04 12:48:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.13% (1.2477 => 1.2336, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0955, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9199 => 0.9499, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3672, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.6959 => 0.7178, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1623, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2318, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4138, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5871, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 2.14% (1.9270 => 1.9683, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (3.8646 => 3.9447, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.3819 => 1.4101, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.89% (1.1061 => 1.1270, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9117, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5252, std. dev.: 0.0086) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3896, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0542, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7085, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0362) SingleSource/Benchmarks/Misc/mandel-2: 7.37% (1.2998 => 1.3956, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6961, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4525, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1158, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.24% (4.5928 => 4.6958, std. dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 2.01% (3.7731 => 3.8489, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0756, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.82% (0.4657 => 0.3734, std. dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.5627 => 20.8661, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.66% (0.3511 => 0.3277, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3623 => 0.3446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3650 => 0.3475, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3601 => 0.3429, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3663 => 0.3491, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.58% (0.3578 => 0.3414, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.28% (0.3789 => 0.3627, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.02% (0.4003 => 0.3842, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.88% (0.8818 => 0.8564, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.82% (0.6250 => 0.6074, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2162, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9208, std. dev.: 0.0340) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1598, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1176, std. dev.: 0.0268) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.34% (8.8259 => 8.7078, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 08:32:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 10:32:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604153224.7E8F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/912?compare_to=911&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 912, Order: 157929, Start Time: 2012-06-04 14:37:04, End Time: 2012-06-04 15:33:34 To: 911, Order: 157925, Start Time: 2012-06-04 13:14:25, End Time: 2012-06-04 14:10:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2336 => 1.2468, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0957, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9199 => 0.9499, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.61% (13.8202 => 14.1808, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 2.59% (2.1791 => 2.2355, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.35% (0.7710 => 0.7891, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.2842 => 13.5863, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4891, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4114, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (3.8646 => 3.9469, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.94% (1.9270 => 1.9644, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (1.3813 => 1.4080, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 1.90% (16.6129 => 16.9282, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3899, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5058, std. dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0385, std. dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7091, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1333 => 1.1452, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/fbench: 23.78% (1.8175 => 2.2497, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6967, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5778, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1250, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6984, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 1.30% (1.2308 => 1.2468, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.27% (5.0168 => 5.0805, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std. dev.: 0.0216) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8577, std. dev.: 0.0237) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.77% (0.3650 => 0.3476, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3601 => 0.3430, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.75% (0.3623 => 0.3451, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.64% (0.3663 => 0.3493, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3646 => 0.3478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.58% (0.3578 => 0.3414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.06% (0.3914 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4003 => 0.3843, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6250 => 0.6076, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (1.9828 => 1.9624, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3210, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2187, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9418, std. dev.: 0.0082) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1538, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1088, std. dev.: 0.0220) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8001, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6953, std. dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 11:23:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 13:23:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604182355.1FA5C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/913?compare_to=912&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 913, Order: 157933, Start Time: 2012-06-04 17:28:34, End Time: 2012-06-04 18:25:04 To: 912, Order: 157929, Start Time: 2012-06-04 14:37:04, End Time: 2012-06-04 15:33:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (2.0176 => 2.2807, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0968, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.58% (1.1364 => 1.1657, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.50% (13.8202 => 14.1659, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.41% (2.1791 => 2.2317, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.31% (1.3813 => 1.4132, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5875, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9651, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9409, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.87% (16.6129 => 16.9241, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.53% (16.2614 => 16.5100, std. dev.: 0.0203) MultiSource/Applications/hbd/hbd: 1.49% (1.3693 => 1.3897, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7038 => 0.7142, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0506, std. dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7101, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1333 => 1.1458, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0292) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (2.8606 => 2.9383, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6978, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1057, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.47% (0.4657 => 0.3657, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8710, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.66% (0.3511 => 0.3277, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3601 => 0.3429, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.68% (0.3650 => 0.3479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.61% (0.3663 => 0.3494, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3646 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.58% (0.3578 => 0.3414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -4.11% (0.3940 => 0.3778, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: -4.04% (0.3914 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4003 => 0.3843, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8875, std. dev.: 0.0345) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2258, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1581, std. dev.: 0.0510) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1094, std. dev.: 0.0353) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7997, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7032, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 12:46:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 14:46:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604194638.8ACC42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/914?compare_to=913&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 914, Order: 157939, Start Time: 2012-06-04 18:51:22, End Time: 2012-06-04 19:47:48 To: 913, Order: 157933, Start Time: 2012-06-04 17:28:34, End Time: 2012-06-04 18:25:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.28% (2.0176 => 2.2856, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9199 => 0.9502, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (3.9660 => 4.0917, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 2.63% (2.1791 => 2.2365, std. dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1777, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.2842 => 13.5701, std. dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 2.04% (16.6129 => 16.9512, std. dev.: 0.0124) MultiSource/Applications/hbd/hbd: 2.02% (1.3693 => 1.3969, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9413, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 1.97% (1.9270 => 1.9649, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.88% (1.1061 => 1.1269, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.55% (1.3819 => 1.4033, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.44% (1.3813 => 1.4012, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4814, std. dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0317, std. dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7091, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2556, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 6.77% (1.2998 => 1.3878, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.89% (1.9144 => 1.9889, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5759, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1339, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6972, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3270, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0281) MultiSource/Applications/lemon/lemon: 1.35% (1.4298 => 1.4491, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0726, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.37% (0.4657 => 0.3615, std. dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.31% (22.5627 => 20.9142, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.05% (0.3623 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3650 => 0.3468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.92% (0.3601 => 0.3424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.86% (0.3578 => 0.3404, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3663 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.83% (0.3646 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.54% (0.3940 => 0.3761, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.29% (0.3914 => 0.3746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.15% (0.4003 => 0.3837, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.21% (0.6250 => 0.6112, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0242) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4104, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2110, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9061, std. dev.: 0.0802) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5114, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1662, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7985, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1307, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.22% (8.8259 => 8.7181, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 14:09:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 16:09:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604210913.38B262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/915?compare_to=914&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 915, Order: 157946, Start Time: 2012-06-04 20:13:58, End Time: 2012-06-04 21:10:22 To: 914, Order: 157939, Start Time: 2012-06-04 18:51:22, End Time: 2012-06-04 19:47:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.03% (2.0176 => 2.2804, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0970, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.3245 => 1.3633, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.67% (2.1791 => 2.2372, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1879, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9491, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (13.2842 => 13.5671, std. dev.: 0.0176) MultiSource/Applications/kimwitu++/kc: 2.09% (16.6129 => 16.9600, std. dev.: 0.0214) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.00% (1.9270 => 1.9656, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.83% (1.3819 => 1.4072, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4065, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4959, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0345, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.12% (3.6692 => 3.7103, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.1333 => 1.1454, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0513) SingleSource/Benchmarks/Misc/mandel-2: 6.96% (1.2998 => 1.3903, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.78% (1.7688 => 1.8356, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6914, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5758, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1310, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6990, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0094) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.35% (5.0168 => 5.0845, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.79% (0.4657 => 0.3549, std. dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9015, std. dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3623 => 0.3430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3601 => 0.3413, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.16% (0.3663 => 0.3474, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.00% (0.3578 => 0.3399, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.75% (0.3789 => 0.3609, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.47% (0.3914 => 0.3739, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4003 => 0.3826, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.36% (0.6576 => 0.6421, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.35% (0.6250 => 0.6103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.76% (0.5748 => 0.5647, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4095, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2155, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5007, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1547, std. dev.: 0.0382) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9963, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.55% (8.8259 => 8.6895, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1168, std. dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8005, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 15:33:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 17:33:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604223347.C28122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/916?compare_to=915&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 916, Order: 157950, Start Time: 2012-06-04 21:38:31, End Time: 2012-06-04 22:34:57 To: 915, Order: 157946, Start Time: 2012-06-04 20:13:58, End Time: 2012-06-04 21:10:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (787 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (1.9714 => 1.9916, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2824, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9199 => 0.9505, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.28% (0.6959 => 0.7187, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (3.9660 => 4.0949, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.22% (1.0594 => 1.0935, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3245 => 1.3644, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1924, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.66% (2.1791 => 2.2371, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.50% (1.1364 => 1.1648, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.31% (1.3693 => 1.4009, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.21% (16.6129 => 16.9800, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5764, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4878, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9466, std. dev.: 0.0161) MultiSource/Applications/Burg/burg: 2.11% (1.1061 => 1.1294, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9668, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (0.7038 => 0.7177, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4063, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.38% (16.2614 => 16.4862, std. dev.: 0.0273) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0480, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7134, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6434, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4019, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6969, std. dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5758, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1243, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.19% (4.5928 => 4.6934, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3268, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0138) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.16% (0.4657 => 0.3625, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.41% (22.5627 => 20.8900, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3623 => 0.3450, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: -4.61% (0.3601 => 0.3435, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.56% (0.3663 => 0.3496, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: -4.50% (0.3578 => 0.3417, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -4.11% (0.3940 => 0.3778, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.97% (0.6250 => 0.6127, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.02% (0.3139 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1483, std. dev.: 0.0457) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2285, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9549, std. dev.: 0.0358) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8012, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0031) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1299, std. dev.: 0.0311) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7031, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 16:56:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 18:56:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120604235656.685E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/917?compare_to=916&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 917, Order: 157955, Start Time: 2012-06-04 23:01:44, End Time: 2012-06-04 23:58:05 To: 916, Order: 157950, Start Time: 2012-06-04 21:38:31, End Time: 2012-06-04 22:34:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.19% (33.1970 => 32.8020, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.18% (1.9916 => 1.9680, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2640, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9199 => 0.9488, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0857, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1584, std. dev.: 0.0071) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1364 => 1.1617, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9380, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5235, std. dev.: 0.0102) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.75% (1.1061 => 1.1255, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4050, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.59% (16.6129 => 16.8763, std. dev.: 0.0238) MultiSource/Applications/hbd/hbd: 1.52% (1.3693 => 1.3901, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4618, std. dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0206, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0410) MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.43% (0.0957 => 0.1076, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1151, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6971, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0718, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.72% (0.4657 => 0.3599, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.62% (22.5627 => 20.8427, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.90% (0.9108 => 0.8935, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -1.88% (0.5748 => 0.5640, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (33.2944 => 32.8020, std. dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (6.2785 => 6.2133, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2144, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1480, std. dev.: 0.0418) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9339, std. dev.: 0.0552) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.59% (26.5159 => 26.0940, std. dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8013, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.27% (8.8259 => 8.7137, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 18:19:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 20:19:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605011929.105B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/918?compare_to=917&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 918, Order: 157966, Start Time: 2012-06-05 00:24:17, End Time: 2012-06-05 01:20:37 To: 917, Order: 157955, Start Time: 2012-06-04 23:01:44, End Time: 2012-06-04 23:58:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.17% (2.0176 => 2.2834, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0928, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.9199 => 0.9481, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.3245 => 1.3609, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1611, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2290, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9462, std. dev.: 0.0295) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.4563 => 1.4844, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9363, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1265, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.82% (1.3819 => 1.4071, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5248, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.7710 => 0.7847, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.59% (0.7038 => 0.7150, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4900, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3884, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0125, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3984, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6958, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5771, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.32% (4.5928 => 4.6992, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1099, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1765, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.09% (5.0168 => 5.0716, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.71% (0.4657 => 0.3646, std. dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8757, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.22% (33.2944 => 32.8872, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (6.2785 => 6.2155, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0102) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6940, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1628, std. dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9824, std. dev.: 0.0584) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0081) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1223, std. dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.17% (8.8259 => 8.7226, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8464, std. dev.: 0.0145) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 19:42:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 4 Jun 2012 21:42:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605024202.E49E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/919?compare_to=918&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 919, Order: 157974, Start Time: 2012-06-05 01:46:47, End Time: 2012-06-05 02:43:12 To: 918, Order: 157966, Start Time: 2012-06-05 00:24:17, End Time: 2012-06-05 01:20:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (785 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2758, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0951, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.9199 => 0.9493, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.80% (1.3245 => 1.3616, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1697, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.2193 => 1.2489, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 2.37% (2.1791 => 2.2308, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9411, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5408, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.7710 => 0.7857, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.87% (1.9270 => 1.9630, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4064, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9075, std. dev.: 0.0095) MultiSource/Applications/Burg/burg: 1.77% (1.1061 => 1.1257, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (0.7038 => 0.7138, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.23% (14.8535 => 15.0355, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4539, std. dev.: 0.0219) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7087, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.07% (1.3693 => 1.3839, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6997, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5756, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1144, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.23% (4.5928 => 4.6953, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3270, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0091) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1756, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.09% (5.0168 => 5.0715, std. dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.80% (0.4657 => 0.3642, std. dev.: 0.0272) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.66% (22.5627 => 20.8338, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3663 => 0.3519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: -2.05% (0.5748 => 0.5630, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: -1.79% (0.5818 => 0.5714, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.23% (33.2944 => 32.8856, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (4.9865 => 4.9359, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9457, std. dev.: 0.0452) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6961, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.74% (9.3358 => 9.1732, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6901, std. dev.: 0.0273) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0065) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1362, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.07% (2.5254 => 2.4985, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 4 22:14:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 00:14:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605051450.4C16E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/920?compare_to=919&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 920, Order: 157981, Start Time: 2012-06-05 04:19:33, End Time: 2012-06-05 05:15:59 To: 919, Order: 157974, Start Time: 2012-06-05 01:46:47, End Time: 2012-06-05 02:43:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.02% (0.3330 => 0.3464, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -4.90% (2.6468 => 2.5171, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.95% (2.0176 => 2.2789, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (3.9660 => 4.0917, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1598, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.2193 => 1.2482, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2290, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1364 => 1.1617, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9376, std. dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 1.88% (16.6129 => 16.9248, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 1.85% (1.1061 => 1.1266, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3819 => 1.4069, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (13.2842 => 13.5152, std. dev.: 0.0168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 1.21% (1.3693 => 1.3859, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4585, std. dev.: 0.0158) MultiSource/Applications/SIBsim4/SIBsim4: 1.06% (1.2749 => 1.2884, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.03% (14.8535 => 15.0068, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0532) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.40% (7.4271 => 7.6797, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1064, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.24% (4.5928 => 4.6955, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 1.40% (5.0168 => 5.0872, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (1.9290 => 1.9544, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.49% (0.4657 => 0.3656, std. dev.: 0.0200) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8676, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.30% (0.6576 => 0.6425, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.5818 => 0.5718, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.18% (33.2944 => 32.9013, std. dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (6.2785 => 6.2156, std. dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -4.91% (2.6470 => 2.5171, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2255, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4998, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9382, std. dev.: 0.0704) MultiSource/Applications/minisat/minisat: -1.74% (9.3358 => 9.1730, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7644, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1196, std. dev.: 0.0350) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7040, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 02:11:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 04:11:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605091112.084132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/921?compare_to=920&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 921, Order: 157987, Start Time: 2012-06-05 08:15:38, End Time: 2012-06-05 09:12:20 To: 920, Order: 157981, Start Time: 2012-06-05 04:19:33, End Time: 2012-06-05 05:15:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (3.9660 => 4.0948, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9199 => 0.9488, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1789, std. dev.: 0.0234) MultiSource/Applications/siod/siod: 2.53% (2.1791 => 2.2342, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.21% (3.8646 => 3.9499, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9675, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5449, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4840, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1265, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.84% (1.9270 => 1.9624, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4057, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.59% (1.3693 => 1.3911, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.39% (16.2614 => 16.4878, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0341, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (3.6692 => 3.7080, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2656, std. dev.: 0.0478) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4102, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6996, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.77% (11.2619 => 11.5742, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1291, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6985, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2459, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9511, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9386, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.06% (0.3646 => 0.3498, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.07% (0.6576 => 0.6440, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (6.2785 => 6.2092, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5156, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2113, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1662, std. dev.: 0.0227) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9722, std. dev.: 0.0621) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7685, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.41% (8.8259 => 8.7017, std. dev.: 0.0115) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1462, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 03:34:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 05:34:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605103405.1A66D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/922?compare_to=921&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 922, Order: 157989, Start Time: 2012-06-05 09:38:37, End Time: 2012-06-05 10:35:14 To: 921, Order: 157987, Start Time: 2012-06-05 08:15:38, End Time: 2012-06-05 09:12:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.39% (2.2656 => 2.3425, std. dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.51% (0.4334 => 0.3922, std. dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0929, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.3245 => 1.3603, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1835, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1364 => 1.1632, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8646 => 3.9431, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 2.03% (16.6129 => 16.9503, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5339, std. dev.: 0.0188) MultiSource/Applications/treecc/treecc: 1.85% (1.9270 => 1.9627, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1265, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.80% (1.3819 => 1.4068, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7038 => 0.7147, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.35% (1.3693 => 1.3878, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4784, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0213, std. dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7091, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 28.89% (1.8175 => 2.3425, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: 6.86% (1.2998 => 1.3890, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.77% (1.7688 => 1.8354, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6918, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1258, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6989, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3303, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std. dev.: 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9334, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.06% (0.3646 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.65% (0.3940 => 0.3796, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2125, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.91% (2.6470 => 2.5170, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.29% (20.3410 => 19.8755, std. dev.: 0.0888) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2354, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5104, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1656, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7654, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0083) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1290, std. dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.41% (8.8259 => 8.7016, std. dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 07:34:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 09:34:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605143404.195872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/923?compare_to=922&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 923, Order: 157996, Start Time: 2012-06-05 13:38:40, End Time: 2012-06-05 14:35:15 To: 922, Order: 157989, Start Time: 2012-06-05 09:38:37, End Time: 2012-06-05 10:35:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.53% (1.3890 => 1.4103, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.74% (2.3425 => 2.2549, std. dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2853, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0924, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.3245 => 1.3609, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1742, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2312, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2474, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1364 => 1.1617, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9471, std. dev.: 0.0178) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9406, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5443, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9617, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4058, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.75% (1.3819 => 1.4061, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4750, std. dev.: 0.0093) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3866, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0250, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7112, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7010, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.76% (11.2619 => 11.5732, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1133, std. dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.5928 => 4.6965, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.68% (3.2729 => 3.3279, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.24% (5.0168 => 5.0792, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2460, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9331, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.2785 => 6.2091, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3042, std. dev.: 0.0093) SingleSource/UnitTests/Vector/multiplies: -4.91% (2.6470 => 2.5171, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9420, std. dev.: 0.0194) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5027, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2328, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1602, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.75% (8.8259 => 8.6711, std. dev.: 0.0266) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7650, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1271, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 10:44:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 12:44:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605174421.51E232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/924?compare_to=923&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 924, Order: 158002, Start Time: 2012-06-05 16:48:43, End Time: 2012-06-05 17:45:29 To: 923, Order: 157996, Start Time: 2012-06-05 13:38:40, End Time: 2012-06-05 14:35:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (799 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2846, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0988, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2024, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (1.3245 => 1.3597, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.43% (2.1791 => 2.2320, std. dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9734, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (13.2842 => 13.5543, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8646 => 3.9424, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4848, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (1.3813 => 1.4082, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.78% (1.9270 => 1.9613, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (0.7038 => 0.7144, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (3.6692 => 3.7169, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 1.27% (1.3693 => 1.3867, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0403, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4597, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/mandel-2: 7.75% (1.2998 => 1.4005, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7028, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5746, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1139, std. dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6987, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.70% (3.2729 => 3.3286, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.28% (0.4657 => 0.4225, std. dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9446, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.93% (0.3650 => 0.3543, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.88% (0.3578 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.84% (0.3663 => 0.3559, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.93% (2.6470 => 2.5165, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1620, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9765, std. dev.: 0.0540) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7690, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8561, std. dev.: 0.0088) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1028, std. dev.: 0.0216) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.29% (8.8259 => 8.7119, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 12:08:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 14:08:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605190836.F260A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/925?compare_to=924&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 925, Order: 158005, Start Time: 2012-06-05 18:11:57, End Time: 2012-06-05 19:09:47 To: 924, Order: 158002, Start Time: 2012-06-05 16:48:43, End Time: 2012-06-05 17:45:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (799 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.31% (2.0176 => 2.2861, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (3.9660 => 4.1022, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.29% (0.6959 => 0.7188, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2007, std. dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.63% (0.7710 => 0.7913, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.19% (1.3819 => 1.4121, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9488, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (13.2842 => 13.5533, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.00% (16.6129 => 16.9445, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.91% (1.3813 => 1.4077, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9610, std. dev.: 0.0095) MultiSource/Applications/hbd/hbd: 1.69% (1.3693 => 1.3925, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0498, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7162, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4648, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6434, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1448, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.97% (1.2998 => 1.3774, std. dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.45% (7.4271 => 7.6837, std. dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.77% (11.2619 => 11.5741, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6979, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1074, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.17% (13.3668 => 13.5228, std. dev.: 0.0094) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0746, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9628, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.38% (0.3511 => 0.3322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3623 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3650 => 0.3541, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -2.97% (0.3601 => 0.3494, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.54% (0.3940 => 0.3840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.11% (33.2944 => 32.9260, std. dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.95% (2.6470 => 2.5160, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9412, std. dev.: 0.0897) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1579, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7658, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1012, std. dev.: 0.0507) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6898, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 14:49:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 16:49:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605214926.BF4312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/926?compare_to=925&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 926, Order: 158019, Start Time: 2012-06-05 20:54:03, End Time: 2012-06-05 21:50:36 To: 925, Order: 158005, Start Time: 2012-06-05 18:11:57, End Time: 2012-06-05 19:09:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 10 (58 on baseline) Performance Improvements: 5 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 879 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.16% (0.9965 => 1.0778, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 7.20% (2.0455 => 2.1928, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (12.4487 => 12.9203, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 2.82% (1.1311 => 1.1630, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 2.06% (1.3774 => 1.4058, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.69% (0.9540 => 0.9701, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 1.38% (2.5160 => 2.5506, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.35% (26.1012 => 26.4545, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.19% (1.6756 => 1.6955, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.32% (2.2861 => 2.2559, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -6.12% (5.7519 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.44% (4.1006 => 4.0417, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: -1.27% (2.9981 => 2.9601, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.81% (2.0176 => 2.2559, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (3.9660 => 4.0765, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0594 => 1.0882, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (1.3245 => 1.3597, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2274, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.20% (13.8202 => 14.1245, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2193 => 1.2459, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9062, std. dev.: 0.0219) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9305, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5061, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1234, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.47% (1.3813 => 1.4016, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.46% (1.3819 => 1.4021, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4478, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.03% (1.3693 => 1.3834, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.36% (1.8175 => 2.2784, std. dev.: 0.0399) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4058, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.15% (1.5824 => 1.6955, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7197, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.32% (1.7688 => 1.8276, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4598, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5705, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1219, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.5928 => 4.7043, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.19% (3.2729 => 3.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.55% (22.5627 => 20.8595, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.50% (0.3578 => 0.3417, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.45% (0.3663 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.26% (0.3940 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.3789 => 0.3631, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.01% (0.3914 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4003 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.86% (0.6576 => 0.6388, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.46% (33.2944 => 32.8079, std. dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2042, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.00% (1.9828 => 1.9629, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0213) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4112, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.34% (1.9762 => 1.9102, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1162, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9601, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9415, std. dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (4.1080 => 4.0417, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7734, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2603, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.46% (8.8259 => 8.6971, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4905, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8456, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 16:12:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 18:12:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120605231221.A529F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/927?compare_to=926&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 927, Order: 158022, Start Time: 2012-06-05 22:16:56, End Time: 2012-06-05 23:13:32 To: 926, Order: 158019, Start Time: 2012-06-05 20:54:03, End Time: 2012-06-05 21:50:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (63 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.12% (1.4016 => 1.4173, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: 1.07% (25.5202 => 25.7940, std. dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.08% (0.9701 => 0.9596, std. dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9199 => 0.9511, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0985, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.84% (13.8202 => 14.2130, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.70% (2.1791 => 2.2380, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (1.3813 => 1.4173, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.7710 => 0.7905, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.43% (1.3819 => 1.4155, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.40% (0.5577 => 0.5711, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.1364 => 1.1636, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.20% (16.6129 => 16.9780, std. dev.: 0.0170) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9476, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.11% (1.9270 => 1.9677, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.2842 => 13.5483, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3145, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0252, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7111, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1456, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.14% (1.8175 => 2.2926, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3949, std. dev.: 0.0126) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7107, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9225, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.29% (1.7688 => 1.8270, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4616, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5699, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.51% (4.5928 => 4.7083, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1181, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.18% (3.2729 => 3.3116, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9511, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0701, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.99% (0.4657 => 0.3726, std. dev.: 0.0329) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9293, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.81% (0.3623 => 0.3485, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.63% (0.3578 => 0.3448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.06% (33.2944 => 32.9414, std. dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0230) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9092, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1124, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9594, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5103, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (4.1080 => 4.0377, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7754, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.57% (20.3410 => 20.0211, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4884, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7007, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 17:35:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 19:35:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606003522.945692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/928?compare_to=927&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 928, Order: 158038, Start Time: 2012-06-05 23:39:51, End Time: 2012-06-06 00:36:30 To: 927, Order: 158022, Start Time: 2012-06-05 22:16:56, End Time: 2012-06-05 23:13:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.94% (2.2926 => 2.2482, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.6959 => 0.7181, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.9199 => 0.9487, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0885, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3642, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.54% (13.8202 => 14.1717, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.44% (2.1791 => 2.2322, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.2193 => 1.2483, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.2842 => 13.5699, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4113, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.10% (16.6129 => 16.9619, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9366, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.4563 => 1.4834, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1264, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9620, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.52% (1.3693 => 1.3901, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7112, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0197, std. dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4406, std. dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fbench: 23.70% (1.8175 => 2.2482, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1881, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 7.34% (1.2998 => 1.3952, std. dev.: 0.0113) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7148, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.33% (1.7688 => 1.8277, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4623, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5693, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.55% (4.5928 => 4.7101, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1037, std. dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (0.5184 => 0.5285, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3125, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5712, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2308 => 1.2437, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.34% (22.5627 => 20.9076, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.75% (0.3650 => 0.3513, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.58% (0.3578 => 0.3450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.20% (33.2944 => 32.8961, std. dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2074, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1092, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9591, std. dev.: 0.0368) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1080 => 4.0387, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4851, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7755, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2580, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7826, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7044, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 18:57:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 20:57:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606015756.DE44A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/929?compare_to=928&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 929, Order: 158041, Start Time: 2012-06-06 01:02:40, End Time: 2012-06-06 01:59:07 To: 928, Order: 158038, Start Time: 2012-06-05 23:39:51, End Time: 2012-06-06 00:36:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2723, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0856, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.01% (0.9199 => 0.9476, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.38% (13.8202 => 14.1485, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 2.33% (2.1791 => 2.2298, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5831, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.3819 => 1.4102, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.03% (1.1364 => 1.1595, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9381, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 1.89% (16.6129 => 16.9272, std. dev.: 0.0168) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.75% (1.1061 => 1.1255, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.4563 => 1.4815, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (0.7038 => 0.7144, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0088, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4311, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2700, std. dev.: 0.0488) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4067, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7146, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9181, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.32% (1.7688 => 1.8276, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4615, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5702, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.5928 => 4.7062, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1102, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.2308 => 1.2446, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.02% (3.2729 => 3.3063, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.71% (0.4657 => 0.3646, std. dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.43% (22.5627 => 20.8872, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.84% (0.3623 => 0.3484, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.80% (0.3601 => 0.3464, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.66% (0.3578 => 0.3447, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.04% (0.9108 => 0.8922, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2047, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -1.01% (33.2944 => 32.9584, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0160) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9088, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1067, std. dev.: 0.0446) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4867 => 0.4760, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0078, std. dev.: 0.0415) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (4.1080 => 4.0417, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7746, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2577, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7070, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 20:20:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 22:20:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606032032.8862E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/930?compare_to=929&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 930, Order: 158044, Start Time: 2012-06-06 02:25:12, End Time: 2012-06-06 03:21:41 To: 929, Order: 158041, Start Time: 2012-06-06 01:02:40, End Time: 2012-06-06 01:59:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.65% (2.0176 => 2.2728, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (3.9660 => 4.0871, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9199 => 0.9479, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1595, std. dev.: 0.0111) MultiSource/Applications/siod/siod: 2.43% (2.1791 => 2.2320, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5722, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.15% (1.3819 => 1.4116, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8646 => 3.9394, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 1.86% (16.6129 => 16.9212, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4826, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1253, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.49% (1.3693 => 1.3897, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0228, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.00% (3.6692 => 3.7059, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.69% (1.8175 => 2.2481, std. dev.: 0.0580) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 8.23% (1.2998 => 1.4068, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7191, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9615, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.29% (1.7688 => 1.8270, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4598, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5707, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1224, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7054, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 1.39% (1.2308 => 1.2479, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9511, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1793, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5712, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.87% (0.4657 => 0.3685, std. dev.: 0.0278) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.38% (22.5627 => 20.8976, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.99% (0.9108 => 0.8927, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.86% (0.6576 => 0.6454, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2060, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.04% (33.2944 => 32.9475, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9087, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1115, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5000, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9791, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7744, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (4.1080 => 4.0429, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.58% (8.8259 => 8.6861, std. dev.: 0.0255) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7829, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 5 21:44:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 5 Jun 2012 23:44:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606044452.9494A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/931?compare_to=930&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 931, Order: 158046, Start Time: 2012-06-06 03:49:35, End Time: 2012-06-06 04:46:01 To: 930, Order: 158044, Start Time: 2012-06-06 02:25:12, End Time: 2012-06-06 03:21:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2735, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (3.9660 => 4.0862, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.9199 => 0.9477, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3623, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.56% (2.1791 => 2.2348, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.41% (13.8202 => 14.1530, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.7710 => 0.7894, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5791, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4125, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2193 => 1.2460, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9381, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.89% (16.6129 => 16.9265, std. dev.: 0.0154) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.4563 => 1.4820, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9606, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0184, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.01% (16.2614 => 16.4249, std. dev.: 0.0211) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std. dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.18% (2.0200 => 2.1853, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6951, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3867, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.78% (7.4271 => 7.7082, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9187, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.7688 => 1.8271, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4596, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5696, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.44% (4.5928 => 4.7047, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1094, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.66% (0.8273 => 0.8410, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.28% (3.2729 => 3.3147, std. dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0763, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1793, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.43% (0.4657 => 0.3752, std. dev.: 0.0328) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8850, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.01% (0.9108 => 0.8925, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2071, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9089, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9572, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.19% (9.3358 => 9.1313, std. dev.: 0.0211) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0006, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2544, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7746, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (4.1080 => 4.0436, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.26% (8.8259 => 8.7149, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 01:40:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 03:40:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606084020.0CD872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/932?compare_to=931&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 932, Order: 158049, Start Time: 2012-06-06 07:44:57, End Time: 2012-06-06 08:41:30 To: 931, Order: 158046, Start Time: 2012-06-06 03:49:35, End Time: 2012-06-06 04:46:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2723, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.9199 => 0.9475, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3622, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.58% (13.8202 => 14.1764, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.52% (2.1791 => 2.2341, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5792, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.7710 => 0.7878, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1609, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.3819 => 1.4102, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 1.89% (16.6129 => 16.9263, std. dev.: 0.0210) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9372, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1265, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.84% (1.9270 => 1.9624, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3903, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0205, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4343, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.60% (2.0200 => 2.1938, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9996 => 1.0791, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: 7.74% (1.2998 => 1.4004, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6951, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7158, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.7688 => 1.8271, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4614, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5690, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1229, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7040, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3126, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.2308 => 1.2457, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.42% (22.5627 => 20.8880, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.81% (0.3623 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.58% (0.3578 => 0.3450, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.53% (0.6250 => 0.6092, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.99% (0.9108 => 0.8927, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.86% (0.6576 => 0.6454, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.2785 => 6.2086, std. dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: -1.02% (33.2944 => 32.9563, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.39% (1.3780 => 1.3175, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -2.46% (9.3358 => 9.1066, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9572, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9121, std. dev.: 0.0268) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (4.1080 => 4.0426, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7751, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6992, std. dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 03:05:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 05:05:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606100526.E5CE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/933?compare_to=932&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 933, Order: 158054, Start Time: 2012-06-06 09:10:01, End Time: 2012-06-06 10:06:37 To: 932, Order: 158049, Start Time: 2012-06-06 07:44:57, End Time: 2012-06-06 08:41:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.36% (0.4130 => 0.3661, std. dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9199 => 0.9470, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.78% (3.9660 => 4.0764, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.6959 => 0.7150, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3245 => 1.3584, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.26% (2.1791 => 2.2284, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1181, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2193 => 1.2449, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5334, std. dev.: 0.0064) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.79% (16.6129 => 16.9099, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 1.67% (3.8646 => 3.9293, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9587, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4800, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3813 => 1.4037, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2760, std. dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6950, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3868, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7203, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8281, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4602, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.72% (11.2619 => 11.5682, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.5928 => 4.7042, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1138, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.31% (1.9290 => 1.9542, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2308 => 1.2462, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.20% (3.2729 => 3.3121, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.39% (0.4657 => 0.3661, std. dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.64% (22.5627 => 20.8382, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.24% (0.8818 => 0.8532, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6250 => 0.6076, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.28% (0.9108 => 0.8900, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.29% (33.2944 => 32.8655, std. dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.2785 => 6.2088, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.20% (1.0460 => 0.9498, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.40% (1.9762 => 1.9090, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1162, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9111, std. dev.: 0.0463) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2480, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.64% (4.1080 => 4.0407, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7755, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8575, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.53% (8.8259 => 8.6912, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7824, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 04:27:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 06:27:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606112754.C972A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/934?compare_to=933&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 934, Order: 158055, Start Time: 2012-06-06 10:32:39, End Time: 2012-06-06 11:29:05 To: 933, Order: 158054, Start Time: 2012-06-06 09:10:01, End Time: 2012-06-06 10:06:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.31% (2.0176 => 2.2659, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.88% (3.9660 => 4.0803, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.3245 => 1.3609, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0594 => 1.0884, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1358, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.27% (2.1791 => 2.2286, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2451, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.95% (1.1364 => 1.1586, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5359, std. dev.: 0.0155) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9325, std. dev.: 0.0115) MultiSource/Applications/treecc/treecc: 1.73% (1.9270 => 1.9604, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 1.72% (16.6129 => 16.8985, std. dev.: 0.0225) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4044, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.4563 => 1.4805, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7038 => 0.7142, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.36% (1.3693 => 1.3879, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/fbench: 26.00% (1.8175 => 2.2900, std. dev.: 0.0396) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6953, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3885, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7164, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4606, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.72% (11.2619 => 11.5687, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.5928 => 4.7044, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.13% (7.9275 => 8.0961, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9538, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.23% (3.2729 => 3.3131, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5716, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.36% (0.4657 => 0.3709, std. dev.: 0.0234) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.5627 => 20.8607, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.19% (0.3601 => 0.3450, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.19% (0.8818 => 0.8537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.70% (0.6250 => 0.6081, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.12% (0.9108 => 0.8915, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -1.97% (0.5748 => 0.5635, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.20% (33.2944 => 32.8934, std. dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2117, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.48% (1.9762 => 1.9074, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9567, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -2.26% (9.3358 => 9.1252, std. dev.: 0.0359) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9745, std. dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7753, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (4.1080 => 4.0442, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.8259 => 8.7061, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 06:29:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 08:29:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606132956.016692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/935?compare_to=934&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 935, Order: 158063, Start Time: 2012-06-06 12:34:41, End Time: 2012-06-06 13:31:07 To: 934, Order: 158055, Start Time: 2012-06-06 10:32:39, End Time: 2012-06-06 11:29:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (787 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2635, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.9199 => 0.9466, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.77% (3.9660 => 4.0757, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.3245 => 1.3576, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1186, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.2193 => 1.2438, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.89% (1.1364 => 1.1579, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5344, std. dev.: 0.0172) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.7710 => 0.7846, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4056, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9298, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4803, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.64% (16.6129 => 16.8854, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.61% (1.3813 => 1.4036, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9573, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3865, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0251) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.98% (1.2998 => 1.4035, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7163, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9180, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.7688 => 1.8267, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4606, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5699, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1247, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.46% (4.5928 => 4.7057, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1793, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5715, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.5627 => 20.8521, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.6576 => 0.6416, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.21% (0.9108 => 0.8907, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.00% (0.5748 => 0.5633, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.32% (33.2944 => 32.8551, std. dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2082, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (1.9828 => 1.9620, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9095, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1176, std. dev.: 0.0349) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9579, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8951, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5002, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.78% (4.1080 => 4.0350, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.59% (3.9173 => 3.8550, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7748, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7070, std. dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 08:20:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 10:20:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606152026.60AD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/936?compare_to=935&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 936, Order: 158069, Start Time: 2012-06-06 14:25:14, End Time: 2012-06-06 15:21:38 To: 935, Order: 158063, Start Time: 2012-06-06 12:34:41, End Time: 2012-06-06 13:31:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (787 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.20% (2.0176 => 2.2638, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9199 => 0.9471, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (3.9660 => 4.0799, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.72% (1.3245 => 1.3605, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.2193 => 1.2476, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2290, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 2.21% (13.8202 => 14.1250, std. dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.1364 => 1.1581, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5376, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.83% (1.1061 => 1.1263, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9123, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9325, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.4563 => 1.4812, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.71% (1.9270 => 1.9599, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7038 => 0.7147, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3888, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 25.63% (1.8175 => 2.2834, std. dev.: 0.0432) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.15% (0.9996 => 1.0811, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.68% (1.2998 => 1.3996, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6951, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7134, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.36% (1.7688 => 1.8283, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4601, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5700, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7041, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1108, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5184 => 0.5287, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.97% (0.4657 => 0.3820, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8715, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-2: -4.19% (0.3601 => 0.3450, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.04% (0.9108 => 0.8922, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.17% (33.2944 => 32.9050, std. dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (6.2785 => 6.2105, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.44% (1.9762 => 1.9082, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1192, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9608, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9247, std. dev.: 0.0286) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.63% (4.1080 => 4.0411, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7739, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2581, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.50% (8.8259 => 8.6934, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 09:43:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 11:43:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606164309.E88972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/937?compare_to=936&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 937, Order: 158073, Start Time: 2012-06-06 15:47:47, End Time: 2012-06-06 16:44:21 To: 936, Order: 158069, Start Time: 2012-06-06 14:25:14, End Time: 2012-06-06 15:21:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (68 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.4019 => 1.4243, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.00% (20.8715 => 21.0805, std. dev.: 0.0212) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.83% (2.0176 => 2.2765, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0594 => 1.0956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.0999, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.11% (1.3813 => 1.4243, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3648, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2120, std. dev.: 0.0155) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2405, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.7710 => 0.7916, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.61% (16.6129 => 17.0462, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4158, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.6007, std. dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9546, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9712, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.24% (0.7038 => 0.7196, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.01% (1.3693 => 1.3968, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0672, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7218, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.19% (16.2614 => 16.4545, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6532, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3118, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1007 => 2.1233, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.02% (1.8175 => 2.2905, std. dev.: 0.0355) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6951, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.88% (7.4271 => 7.7156, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.31% (1.7688 => 1.8274, std. dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4602, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5702, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1373, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.44% (4.5928 => 4.7049, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (0.5184 => 0.5289, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.20% (3.2729 => 3.3122, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1796, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.5627 => 21.0805, std. dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.16% (0.3578 => 0.3429, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.05% (0.6250 => 0.6122, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.48% (1.9762 => 1.9074, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1166, std. dev.: 0.0272) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9596, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9529, std. dev.: 0.0671) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (4.1080 => 4.0432, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7774, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6902, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7826, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 11:05:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 13:05:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606180542.00CF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/938?compare_to=937&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 938, Order: 158079, Start Time: 2012-06-06 17:10:26, End Time: 2012-06-06 18:06:53 To: 937, Order: 158073, Start Time: 2012-06-06 15:47:47, End Time: 2012-06-06 16:44:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (67 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.66% (3.7668 => 3.8669, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/fbench: 2.10% (2.2905 => 2.3386, std. dev.: 0.0133) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2775, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.6959 => 0.7196, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (3.9660 => 4.1010, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2432, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3245 => 1.3629, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1902, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 2.65% (16.6129 => 17.0536, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.1364 => 1.1645, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (3.8646 => 3.9571, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.6003, std. dev.: 0.0195) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7038 => 0.7202, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4136, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.23% (1.9270 => 1.9699, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4112, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.03% (1.3693 => 1.3971, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (1.4563 => 1.4853, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4889, std. dev.: 0.0160) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0467, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7123, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3125, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6471, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 28.67% (1.8175 => 2.3386, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4115, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7232, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.31% (1.7688 => 1.8273, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4599, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9776, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5698, std. dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 2.49% (3.7731 => 3.8669, std. dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1221, std. dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7054, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.64% (0.8273 => 0.8409, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.05% (5.5130 => 5.5708, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0248, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.86% (0.3623 => 0.3447, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3601 => 0.3430, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.74% (0.3650 => 0.3477, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3646 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.61% (0.3578 => 0.3413, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.48% (0.3663 => 0.3499, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.30% (0.3789 => 0.3626, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.39% (0.9108 => 0.8981, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5496, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9086, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1171, std. dev.: 0.0536) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9647, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.79% (4.1080 => 4.0344, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7749, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.57% (8.8259 => 8.6873, std. dev.: 0.0247) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7828, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 12:28:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 14:28:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606192818.910D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/939?compare_to=938&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 939, Order: 158088, Start Time: 2012-06-06 18:33:05, End Time: 2012-06-06 19:29:30 To: 938, Order: 158079, Start Time: 2012-06-06 17:10:26, End Time: 2012-06-06 18:06:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.06% (2.0176 => 2.2609, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9199 => 0.9492, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (3.9660 => 4.0844, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2326, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1460, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5477, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9411, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (1.3819 => 1.4084, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.85% (16.6129 => 16.9195, std. dev.: 0.0210) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4065, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.79% (1.9270 => 1.9614, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.4563 => 1.4816, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.51% (1.3693 => 1.3900, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0089, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7065, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 23.77% (1.8175 => 2.2496, std. dev.: 0.0550) SingleSource/Benchmarks/Misc/mandel-2: 8.98% (1.2998 => 1.4165, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.79% (7.4271 => 7.7089, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.38% (1.7688 => 1.8286, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4620, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5701, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7051, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1066, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.88% (0.4657 => 0.3731, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9303, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.43% (0.8818 => 0.8604, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5515, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1051, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9577, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9317, std. dev.: 0.0361) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7748, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (4.1080 => 4.0435, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7820, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (8.8259 => 8.7127, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 13:51:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 15:51:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606205112.115CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/940?compare_to=939&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 940, Order: 158093, Start Time: 2012-06-06 19:55:49, End Time: 2012-06-06 20:52:23 To: 939, Order: 158088, Start Time: 2012-06-06 18:33:05, End Time: 2012-06-06 19:29:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.26% (2.2496 => 2.2780, std. dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.15% (2.0176 => 2.2627, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0921, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.6959 => 0.7179, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3656, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1799, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.7710 => 0.7893, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.29% (3.8646 => 3.9531, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5837, std. dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9735, std. dev.: 0.0137) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.03% (1.9270 => 1.9661, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4845, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4082, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.87% (1.3813 => 1.4071, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3932, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4722, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0407, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.1333 => 1.1469, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7113, std. dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.34% (1.8175 => 2.2780, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7187, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4604, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5703, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.5928 => 4.7062, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1156, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.23% (3.2729 => 3.3132, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9451, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.04% (33.2944 => 32.9465, std. dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.69% (2.6470 => 2.5492, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9093, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1106, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9464, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.81% (4.1080 => 4.0337, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7745, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6981, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7828, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 15:14:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 17:14:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606221434.637B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/941?compare_to=940&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 941, Order: 158106, Start Time: 2012-06-06 21:19:17, End Time: 2012-06-06 22:15:46 To: 940, Order: 158093, Start Time: 2012-06-06 19:55:49, End Time: 2012-06-06 20:52:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2735, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9199 => 0.9478, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.40% (1.3245 => 1.3563, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.38% (13.8202 => 14.1494, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2193 => 1.2466, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2277, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4114, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9407, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.2842 => 13.5264, std. dev.: 0.0191) MultiSource/Applications/hbd/hbd: 1.81% (1.3693 => 1.3941, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.4563 => 1.4820, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.76% (16.6129 => 16.9053, std. dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9607, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4331, std. dev.: 0.0228) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0083, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.88% (1.8175 => 2.3061, std. dev.: 0.0273) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.33% (0.9996 => 1.0829, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.19% (2.0200 => 2.1854, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7131, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.38% (1.7688 => 1.8285, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4613, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5696, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.46% (4.5928 => 4.7057, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.07% (7.9275 => 8.0918, std. dev.: 0.0203) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0076) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.22% (3.2729 => 3.3128, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.2308 => 1.2448, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.76% (0.4657 => 0.3597, std. dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9196, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.72% (0.3623 => 0.3452, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3650 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.47% (0.3578 => 0.3418, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.81% (0.6576 => 0.6391, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2128, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.40% (1.9762 => 1.9091, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1097, std. dev.: 0.0203) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9603, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9242, std. dev.: 0.0413) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.63% (4.1080 => 4.0411, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.60% (28.2225 => 27.7719, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.5254 => 2.4863, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.52% (8.8259 => 8.6914, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 16:37:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 18:37:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120606233707.A1F6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/942?compare_to=941&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 942, Order: 158113, Start Time: 2012-06-06 22:41:54, End Time: 2012-06-06 23:38:19 To: 941, Order: 158106, Start Time: 2012-06-06 21:19:17, End Time: 2012-06-06 22:15:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2723, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0930, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9199 => 0.9486, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.3245 => 1.3607, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.50% (13.8202 => 14.1653, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.44% (2.1791 => 2.2322, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.29% (1.3813 => 1.4129, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2469, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.1364 => 1.1616, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4125, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.21% (16.6129 => 16.9805, std. dev.: 0.0225) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9494, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5390, std. dev.: 0.0221) MultiSource/Applications/hbd/hbd: 1.91% (1.3693 => 1.3954, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9637, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.89% (1.1061 => 1.1270, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0276, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.13% (16.2614 => 16.4446, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2890, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.2292 => 1.2417, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fbench: 24.82% (1.8175 => 2.2686, std. dev.: 0.0352) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 8.13% (1.2998 => 1.4055, std. dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7238, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4605, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5695, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1274, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.46% (4.5928 => 4.7058, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.19% (3.2729 => 3.3118, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.42% (0.4657 => 0.3613, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9086, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.60% (0.8818 => 0.8589, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.21% (0.6250 => 0.6112, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9084, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.30% (9.3358 => 9.1214, std. dev.: 0.0264) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9608, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9752, std. dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1080 => 4.0386, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7753, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6960, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 17:59:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 19:59:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607005945.8FCBD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/943?compare_to=942&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 943, Order: 158119, Start Time: 2012-06-07 00:04:26, End Time: 2012-06-07 01:00:57 To: 942, Order: 158113, Start Time: 2012-06-06 22:41:54, End Time: 2012-06-06 23:38:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2711, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (3.9660 => 4.0940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.67% (2.1791 => 2.2372, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1824, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.27% (16.6129 => 16.9899, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 2.26% (3.8646 => 3.9518, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.20% (1.3819 => 1.4123, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.3813 => 1.4115, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5739, std. dev.: 0.0155) MultiSource/Applications/hbd/hbd: 2.14% (1.3693 => 1.3986, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 2.10% (0.7038 => 0.7186, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9670, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.95% (1.1061 => 1.1277, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4843, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0386, std. dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4504, std. dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.2742 => 3.3121, std. dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1235, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (3.6692 => 3.7082, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.41% (1.2998 => 1.4091, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6950, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7182, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9188, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4603, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5702, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.49% (4.5928 => 4.7070, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.13% (7.9275 => 8.0965, std. dev.: 0.0183) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.87% (0.4657 => 0.3592, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9470, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -5.16% (0.3623 => 0.3436, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3650 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.97% (0.3578 => 0.3400, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.88% (0.3646 => 0.3468, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: -4.25% (0.4003 => 0.3833, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.45% (1.9762 => 1.9081, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1135, std. dev.: 0.0391) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5132, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9904, std. dev.: 0.0459) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.66% (8.8259 => 8.6797, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.65% (4.1080 => 4.0402, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7724, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7819, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 19:22:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 21:22:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607022229.DF38B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/944?compare_to=943&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 944, Order: 158127, Start Time: 2012-06-07 01:27:09, End Time: 2012-06-07 02:23:41 To: 943, Order: 158119, Start Time: 2012-06-07 00:04:26, End Time: 2012-06-07 01:00:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.90% (2.0176 => 2.2577, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.6959 => 0.7184, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (3.9660 => 4.0797, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0594 => 1.0876, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (1.3245 => 1.3597, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5637 => 0.5781, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4328 => 0.4432, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.35% (13.8202 => 14.1445, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2193 => 1.2467, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9689, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9428, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.98% (1.3813 => 1.4086, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.96% (1.3693 => 1.3961, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5421, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (1.3819 => 1.4085, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.84% (1.9270 => 1.9624, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.4563 => 1.4805, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0124, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 26.14% (1.8175 => 2.2926, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7205, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.7688 => 1.8267, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4621, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5698, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.49% (4.5928 => 4.7071, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.07% (7.9275 => 8.0916, std. dev.: 0.0163) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.00% (5.0168 => 5.0672, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.48% (0.4657 => 0.3610, std. dev.: 0.0108) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9433, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.97% (0.3623 => 0.3443, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.88% (0.3650 => 0.3472, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3601 => 0.3427, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.37% (0.3940 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.35% (0.3789 => 0.3624, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: -4.22% (0.3914 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.15% (0.4003 => 0.3837, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.6576 => 0.6345, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2123, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9088, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1181, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8856, std. dev.: 0.0455) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9593, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7751, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (4.1080 => 4.0434, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.29% (8.8259 => 8.7120, std. dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 20:45:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 6 Jun 2012 22:45:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607034501.0457F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/945?compare_to=944&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 945, Order: 158131, Start Time: 2012-06-07 02:49:47, End Time: 2012-06-07 03:46:13 To: 944, Order: 158127, Start Time: 2012-06-07 01:27:09, End Time: 2012-06-07 02:23:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.08% (2.0176 => 2.2614, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0899, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.3245 => 1.3624, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.71% (2.1791 => 2.2381, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1648, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0217, std. dev.: 0.0157) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9514, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5816, std. dev.: 0.0245) MultiSource/Applications/hbd/hbd: 2.23% (1.3693 => 1.3998, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.95% (1.1061 => 1.1277, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0200, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.09% (16.2614 => 16.4383, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3076, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std. dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6947, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std. dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7129, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9188, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.33% (1.7688 => 1.8277, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4595, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5692, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7038, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.12% (7.9275 => 8.0953, std. dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (0.5184 => 0.5289, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.00% (5.0168 => 5.0670, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.55% (0.4657 => 0.3607, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9299, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3623 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.97% (0.3601 => 0.3422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.81% (0.3578 => 0.3406, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3646 => 0.3472, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.94% (0.6250 => 0.6129, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0130) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.34% (1.9762 => 1.9101, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1118, std. dev.: 0.0359) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9316, std. dev.: 0.1039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.75% (6.6320 => 6.5158, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.67% (4.1080 => 4.0392, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7773, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4875, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7036, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7823, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 22:23:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 00:23:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607052358.071162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/946?compare_to=945&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 946, Order: 158136, Start Time: 2012-06-07 04:28:38, End Time: 2012-06-07 05:25:08 To: 945, Order: 158131, Start Time: 2012-06-07 02:49:47, End Time: 2012-06-07 03:46:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.26% (2.2542 => 2.3051, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.03% (2.0176 => 2.2603, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.6959 => 0.7205, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0969, std. dev.: 0.0095) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (1.3245 => 1.3669, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2424, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0559, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.2193 => 1.2516, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1759, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (3.8646 => 3.9590, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.1364 => 1.1640, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.43% (0.4328 => 0.4433, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.36% (1.3693 => 1.4016, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5926, std. dev.: 0.0215) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.30% (1.3813 => 1.4131, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.7710 => 0.7879, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.17% (1.3819 => 1.4119, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4874, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9679, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.37% (14.8535 => 15.0573, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2292 => 1.2456, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4736, std. dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7143, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (3.2742 => 3.3098, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1231, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.83% (1.8175 => 2.3051, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4020, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.09% (1.5824 => 1.6946, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7124, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4604, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5698, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.46% (4.5928 => 4.7056, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1136, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.16% (3.2729 => 3.3109, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1794, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.95% (0.4657 => 0.3635, std. dev.: 0.0272) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9789, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3663 => 0.3510, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.79% (0.6250 => 0.6138, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.32% (0.9108 => 0.8988, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9088, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1200, std. dev.: 0.0254) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9255, std. dev.: 0.0481) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1080 => 4.0387, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7746, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4876, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (8.8259 => 8.7024, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 6 23:46:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 01:46:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607064637.55E5F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/947?compare_to=946&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 947, Order: 158137, Start Time: 2012-06-07 05:51:16, End Time: 2012-06-07 06:47:48 To: 946, Order: 158136, Start Time: 2012-06-07 04:28:38, End Time: 2012-06-07 05:25:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2663, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9199 => 0.9526, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1066, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.6959 => 0.7204, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3672, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.92% (2.1791 => 2.2428, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.84% (16.6129 => 17.0852, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.7710 => 0.7926, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2018, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.2193 => 1.2526, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.69% (1.3693 => 1.4062, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (1.3819 => 1.4165, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4156, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.47% (3.8646 => 3.9599, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.31% (1.1061 => 1.1316, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5831, std. dev.: 0.0123) MultiSource/Applications/treecc/treecc: 2.25% (1.9270 => 1.9703, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2292 => 1.2516, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0879, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7222, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (3.2742 => 3.3197, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.35% (0.7506 => 0.7607, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.1333 => 1.1484, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4685, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.1007 => 2.1267, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (1.9828 => 2.0073, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6541, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0413) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.15% (1.5824 => 1.6956, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7240, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.32% (1.7688 => 1.8275, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4607, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5696, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7051, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.13% (7.9275 => 8.0967, std. dev.: 0.0169) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.25% (3.2729 => 3.3137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.89% (0.4657 => 0.3684, std. dev.: 0.0353) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0011, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3601 => 0.3475, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3663 => 0.3538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3646 => 0.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.6576 => 0.6412, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.35% (1.9762 => 1.9100, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1096, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9170, std. dev.: 0.0417) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.76% (4.1080 => 4.0358, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2570, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7819, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.32% (8.8259 => 8.7093, std. dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 04:24:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 06:24:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607112421.23AF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/948?compare_to=947&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 948, Order: 158146, Start Time: 2012-06-07 10:28:49, End Time: 2012-06-07 11:25:34 To: 947, Order: 158137, Start Time: 2012-06-07 05:51:16, End Time: 2012-06-07 06:47:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (73 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 4.28% (3.7598 => 3.9206, std. dev.: 0.0549) SingleSource/Benchmarks/Misc/mandel-2: 1.31% (1.3812 => 1.3993, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.40% (2.0176 => 2.2677, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1099, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3683, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.21% (0.4328 => 0.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.5637 => 0.5812, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.08% (13.8202 => 14.2463, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2454, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 2.90% (16.6129 => 17.0947, std. dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (1.2193 => 1.2531, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.76% (1.3693 => 1.4071, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1364 => 1.1666, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9672, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (0.7038 => 0.7220, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.3813 => 1.4169, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1337, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4158, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5975, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4883, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.86% (1.2292 => 1.2521, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0855, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (3.2742 => 3.3240, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.1007 => 2.1309, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7218, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.41% (0.7506 => 0.7612, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6533, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4525, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5188 => 1.5364, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7292, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 3.91% (3.7731 => 3.9206, std. dev.: 0.0549) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.28% (1.7688 => 1.8269, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4605, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5699, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.48% (4.5928 => 4.7069, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1087, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 1.30% (1.2308 => 1.2468, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.26% (3.2729 => 3.3141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0190, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.47% (0.3578 => 0.3454, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.94% (0.3914 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.33% (1.9762 => 1.9103, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.22% (9.3358 => 9.1287, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9211, std. dev.: 0.0338) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7728, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (4.1080 => 4.0428, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2619, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.25% (8.8259 => 8.7152, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8454, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 08:49:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 10:49:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607154957.24F272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/949?compare_to=948&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 949, Order: 158149, Start Time: 2012-06-07 14:54:36, End Time: 2012-06-07 15:51:10 To: 948, Order: 158146, Start Time: 2012-06-07 10:28:49, End Time: 2012-06-07 11:25:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -4.06% (3.9206 => 3.7616, std. dev.: 0.0193) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.6959 => 0.7208, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (3.9660 => 4.1051, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.19% (0.4328 => 0.4466, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3660, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2447, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0889, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1987, std. dev.: 0.0068) MultiSource/Applications/hbd/hbd: 2.70% (1.3693 => 1.4063, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.7710 => 0.7905, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.3813 => 1.4160, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9610, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 2.40% (0.7038 => 0.7207, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.6002, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4146, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9711, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.88% (1.2292 => 1.2523, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.8535 => 15.0822, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1333 => 1.1500, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3201, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1266, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (1.9828 => 2.0065, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4518, std. dev.: 0.0172) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6515, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5354, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2656, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/mandel-2: 8.70% (1.2998 => 1.4129, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7176, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9180, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9622, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0168) MultiSource/Applications/hexxagon/hexxagon: 3.07% (12.0921 => 12.4629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.72% (11.2619 => 11.5685, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7041, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0983, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3125, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.41% (0.4657 => 0.3567, std. dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9869, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3623 => 0.3493, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3578 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.20% (0.3940 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.14% (0.3789 => 0.3670, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4003 => 0.3887, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.40% (1.9762 => 1.9091, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1243, std. dev.: 0.0258) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4867 => 0.4761, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9513, std. dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.78% (4.1080 => 4.0350, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2501, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7760, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7824, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.8259 => 8.7057, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 10:12:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 12:12:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607171238.7C7CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/950?compare_to=949&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 950, Order: 158150, Start Time: 2012-06-07 16:17:16, End Time: 2012-06-07 17:13:52 To: 949, Order: 158149, Start Time: 2012-06-07 14:54:36, End Time: 2012-06-07 15:51:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 3 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.83% (2.2656 => 2.3524, std. dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.85% (2.0065 => 1.9693, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.68% (0.7163 => 0.7043, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -1.64% (1.2523 => 1.2318, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.70% (2.0176 => 2.2739, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1004, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3676, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5637 => 0.5808, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2432, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2088, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (13.2842 => 13.6317, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2193 => 1.2503, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.48% (3.8646 => 3.9604, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.4563 => 1.4908, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (1.3813 => 1.4133, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.30% (16.6129 => 16.9942, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 2.27% (1.1061 => 1.1312, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.26% (1.9270 => 1.9706, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.22% (1.3819 => 1.4126, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.04% (1.3693 => 1.3973, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7228, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0667, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.36% (16.2614 => 16.4830, std. dev.: 0.0236) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1007 => 2.1261, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (6.5754 => 6.6487, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3081, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 29.43% (1.8175 => 2.3524, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1927, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.83% (1.2998 => 1.3886, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7166, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9180, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.26% (1.7688 => 1.8264, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4603, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.75% (11.2619 => 11.5716, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7041, std. dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0983, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 1.28% (1.2308 => 1.2466, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9824, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.11% (0.3663 => 0.3549, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.07% (0.3578 => 0.3468, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.89% (0.3940 => 0.3826, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.73% (0.8818 => 0.8577, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -2.69% (0.3789 => 0.3687, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -2.57% (0.4003 => 0.3900, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.89% (1.3780 => 1.3244, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.49% (1.9762 => 1.9073, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0960, std. dev.: 0.0139) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8812, std. dev.: 0.0675) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.22% (0.4867 => 0.4759, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1080 => 4.0385, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2536, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7744, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7818, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7045, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 11:38:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 13:38:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607183850.CAC0E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/951?compare_to=950&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 951, Order: 158153, Start Time: 2012-06-07 17:43:28, End Time: 2012-06-07 18:40:04 To: 950, Order: 158150, Start Time: 2012-06-07 16:17:16, End Time: 2012-06-07 17:13:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.26% (1.3886 => 1.4061, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -4.15% (2.3524 => 2.2548, std. dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.51% (2.0176 => 2.2701, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.6959 => 0.7198, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (3.9660 => 4.0950, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.22% (1.0594 => 1.0935, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.3245 => 1.3664, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.99% (2.1791 => 2.2443, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1969, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2501, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6108, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.34% (1.3813 => 1.4136, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.26% (3.8646 => 3.9519, std. dev.: 0.0123) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9693, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.17% (1.3819 => 1.4119, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9675, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4870, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7038 => 0.7165, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.66% (1.3693 => 1.3920, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0524, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1333 => 1.1476, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4595, std. dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7133, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3095, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.18% (1.2998 => 1.4061, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6950, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7171, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.29% (1.7688 => 1.8270, std. dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4614, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5693, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.5928 => 4.7042, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1159, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1754, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.01% (1.9290 => 1.9484, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9359, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.75% (0.3623 => 0.3487, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3650 => 0.3514, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.66% (0.3578 => 0.3447, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.32% (0.3940 => 0.3809, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.58% (0.6250 => 0.6089, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9088, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1491, std. dev.: 0.0234) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9388, std. dev.: 0.0235) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.67% (4.1080 => 4.0395, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7757, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7820, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.23% (8.8259 => 8.7173, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 13:01:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 15:01:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607200143.ED8522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/952?compare_to=951&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 952, Order: 158157, Start Time: 2012-06-07 19:06:19, End Time: 2012-06-07 20:02:57 To: 951, Order: 158153, Start Time: 2012-06-07 17:43:28, End Time: 2012-06-07 18:40:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (49 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3680, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (3.9660 => 4.0915, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2432, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2210, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2512, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.2842 => 13.6257, std. dev.: 0.0167) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.44% (1.3813 => 1.4150, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (1.3819 => 1.4148, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9548, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.4563 => 1.4895, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9702, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9679, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.7038 => 0.7174, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.84% (1.3693 => 1.3945, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5581, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1331, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0769, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (3.2742 => 3.3197, std. dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (3.6692 => 3.7169, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.23% (1.1333 => 1.1472, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.10% (6.5754 => 6.6477, std. dev.: 0.0181) MultiSource/Applications/d/make_dparser: 1.02% (3.1889 => 3.2213, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std. dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6950, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7169, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9181, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5701, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1317, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7055, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.28% (3.2729 => 3.3147, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1788, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.63% (0.4657 => 0.3836, std. dev.: 0.0297) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0219, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3601 => 0.3433, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.66% (0.3623 => 0.3454, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3578 => 0.3415, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.55% (0.3646 => 0.3480, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.27% (0.8818 => 0.8618, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.6576 => 0.6427, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -1.76% (0.5748 => 0.5647, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (1.9828 => 1.9585, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (6.2785 => 6.2147, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.45% (1.9762 => 1.9081, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1128, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9592, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9561, std. dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7753, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (4.1080 => 4.0440, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6988, std. dev.: 0.0205) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7826, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 14:24:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 16:24:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607212433.3BBA42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/953?compare_to=952&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 953, Order: 158164, Start Time: 2012-06-07 20:29:07, End Time: 2012-06-07 21:25:45 To: 952, Order: 158157, Start Time: 2012-06-07 19:06:19, End Time: 2012-06-07 20:02:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (72 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (773 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (1.9585 => 1.9784, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.99% (3.7622 => 3.8747, std. dev.: 0.0311) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.15% (2.0176 => 2.2830, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.58% (1.0594 => 1.0973, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1063, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3691, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.23% (2.1791 => 2.2495, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5637 => 0.5817, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8310 => 0.8571, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.13% (13.8202 => 14.2527, std. dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (13.2842 => 13.6411, std. dev.: 0.0121) MultiSource/Applications/treecc/treecc: 2.60% (1.9270 => 1.9771, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.4563 => 1.4939, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.7710 => 0.7905, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (3.8646 => 3.9622, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7460 => 0.7642, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.7038 => 0.7208, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.39% (1.1061 => 1.1325, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.35% (1.3693 => 1.4015, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.33% (16.6129 => 16.9995, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.27% (1.3819 => 1.4133, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.79% (14.8535 => 15.1196, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5358, std. dev.: 0.0411) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.2749 => 1.2961, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.59% (3.2742 => 3.3263, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7274, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1333 => 1.1508, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1331, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (6.5754 => 6.6626, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.5188 => 1.5365, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3941, std. dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7115, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8281, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4601, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.73% (11.2619 => 11.5690, std. dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 2.69% (3.7731 => 3.8747, std. dev.: 0.0311) MultiSource/Applications/sqlite3/sqlite3: 2.45% (4.5928 => 4.7053, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1006, std. dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5184 => 0.5287, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.26% (3.2729 => 3.3140, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.03% (5.5130 => 5.5700, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.5627 => 21.0539, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3601 => 0.3447, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3650 => 0.3494, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3663 => 0.3510, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.26% (0.8818 => 0.8619, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9094, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1091, std. dev.: 0.0169) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9640, std. dev.: 0.0470) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2502, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.64% (4.1080 => 4.0408, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7751, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6980, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 15:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 17:47:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120607224719.39C6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/954?compare_to=953&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 954, Order: 158168, Start Time: 2012-06-07 21:51:57, End Time: 2012-06-07 22:48:32 To: 953, Order: 158164, Start Time: 2012-06-07 20:29:07, End Time: 2012-06-07 21:25:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (773 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2886, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.80% (0.9199 => 0.9549, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (3.9660 => 4.1143, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.70% (1.0594 => 1.0986, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.3245 => 1.3702, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.31% (0.8310 => 0.8585, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.28% (13.8202 => 14.2735, std. dev.: 0.0140) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2496, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1702, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.2193 => 1.2550, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (13.2842 => 13.6436, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.4563 => 1.4948, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.61% (1.1061 => 1.1350, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7038 => 0.7219, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.55% (1.9270 => 1.9761, std. dev.: 0.0112) MultiSource/Applications/hbd/hbd: 2.54% (1.3693 => 1.4041, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (3.8646 => 3.9623, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (1.3819 => 1.4165, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.49% (16.6129 => 17.0270, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.7710 => 0.7894, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4140, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.4791 => 0.4894, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.89% (1.2749 => 1.2990, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.88% (14.8535 => 15.1329, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5591, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (3.6692 => 3.7353, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.2742 => 3.3300, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1354, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.1333 => 1.1506, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.50% (6.5754 => 6.6739, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.26% (1.0313 => 1.0443, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (1.5188 => 1.5375, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2266, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.5298 => 14.6805, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std. dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.20% (2.0200 => 2.1857, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6950, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.88% (7.4271 => 7.7151, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.33% (1.7688 => 1.8277, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4608, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.74% (11.2619 => 11.5701, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.5928 => 4.7064, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1011, std. dev.: 0.0183) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.16% (3.2729 => 3.3108, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.73% (0.4657 => 0.3645, std. dev.: 0.0164) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.60% (22.5627 => 21.0744, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.14% (0.8818 => 0.8629, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.10% (0.6250 => 0.6119, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0114) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9086, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1090, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.36% (20.3410 => 19.8613, std. dev.: 0.0754) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.68% (4.1080 => 4.0388, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7748, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6957, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 17:10:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 19:10:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608001041.5D92E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/955?compare_to=954&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 955, Order: 158175, Start Time: 2012-06-07 23:15:25, End Time: 2012-06-08 00:11:54 To: 954, Order: 158168, Start Time: 2012-06-07 21:51:57, End Time: 2012-06-07 22:48:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (2.0176 => 2.2807, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6959 => 0.7192, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0941, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0936, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2436, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2240, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2193 => 1.2503, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.2842 => 13.6121, std. dev.: 0.0297) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9546, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.18% (1.9270 => 1.9690, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9688, std. dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.93% (1.3693 => 1.3957, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5341, std. dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0674, std. dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (3.6692 => 3.7158, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.20% (2.1007 => 2.1259, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3120, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.1333 => 1.1463, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.10% (6.5754 => 6.6478, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.79% (0.4846 => 0.6968, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0481) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.12% (1.5824 => 1.6951, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7263, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.37% (1.7688 => 1.8284, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4616, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5904, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.97% (7.9275 => 8.0840, std. dev.: 0.0216) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6615, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3126, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.80% (0.4657 => 0.3595, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0212, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3623 => 0.3441, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.88% (0.3650 => 0.3472, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3601 => 0.3426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.47% (0.3940 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.09% (0.3914 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.05% (0.4003 => 0.3841, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.46% (0.9108 => 0.8975, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.26% (1.9828 => 1.9579, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9092, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9561, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -2.23% (9.3358 => 9.1280, std. dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9676, std. dev.: 0.0462) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5139, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.68% (4.1080 => 4.0391, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7745, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2590, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7827, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.32% (8.8259 => 8.7090, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 18:33:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 20:33:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608013318.A75F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/956?compare_to=955&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 956, Order: 158178, Start Time: 2012-06-08 00:38:01, End Time: 2012-06-08 01:34:32 To: 955, Order: 158175, Start Time: 2012-06-07 23:15:25, End Time: 2012-06-08 00:11:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (3.9660 => 4.1017, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.03% (13.8202 => 14.2390, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8310 => 0.8560, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2439, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (13.2842 => 13.6461, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2512, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.50% (0.7710 => 0.7903, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4158, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (3.8646 => 3.9588, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.3819 => 1.4152, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.38% (16.6129 => 17.0083, std. dev.: 0.0200) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9707, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.85% (1.3693 => 1.3946, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.66% (16.2614 => 16.5307, std. dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0847, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1333 => 1.1489, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7197, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1282, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (6.5754 => 6.6558, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.40% (1.2998 => 1.3960, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6953, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7191, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9221, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.26% (1.7688 => 1.8265, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4619, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5908, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1136, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.49% (4.5928 => 4.6613, std. dev.: 0.0110) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3126, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1801, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.21% (0.4657 => 0.3716, std. dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0476, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.66% (0.3578 => 0.3447, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.40% (0.3940 => 0.3806, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.60% (2.6470 => 2.5518, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9093, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1117, std. dev.: 0.0163) MultiSource/Benchmarks/Olden/health/health: -2.29% (0.4533 => 0.4429, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9575, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5004, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9510, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7743, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (4.1080 => 4.0445, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4909, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.33% (8.8259 => 8.7088, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 19:56:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 21:56:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608025601.6B6C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/957?compare_to=956&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 957, Order: 158185, Start Time: 2012-06-08 02:00:42, End Time: 2012-06-08 02:57:14 To: 956, Order: 158178, Start Time: 2012-06-08 00:38:01, End Time: 2012-06-08 01:34:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2785, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6959 => 0.7192, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9199 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.3245 => 1.3677, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (3.9660 => 4.0917, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2420, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2007, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6088, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.1364 => 1.1640, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.11% (16.6129 => 16.9627, std. dev.: 0.0248) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (3.8646 => 3.9459, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (1.3819 => 1.4109, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.10% (1.1061 => 1.1293, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9668, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.03% (1.3813 => 1.4093, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.58% (1.3693 => 1.3909, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5116, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0407, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7114, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (2.1007 => 2.1242, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.1333 => 1.1459, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.87% (1.2998 => 1.3891, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7217, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4625, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5912, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.08% (7.9275 => 8.0921, std. dev.: 0.0158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5928 => 4.6653, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.21% (3.2729 => 3.3125, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.88% (0.4657 => 0.3731, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.5627 => 20.9818, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3623 => 0.3493, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.53% (0.3601 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3578 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/property: -3.20% (0.3940 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -2.92% (0.4003 => 0.3886, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.32% (1.9828 => 1.9566, std. dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2123, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3177, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4112, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1099, std. dev.: 0.0396) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9643, std. dev.: 0.0282) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (4.1080 => 4.0376, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.50% (8.8259 => 8.6938, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7824, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 21:18:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 7 Jun 2012 23:18:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608041846.44FF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/958?compare_to=957&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 958, Order: 158189, Start Time: 2012-06-08 03:23:24, End Time: 2012-06-08 04:20:00 To: 957, Order: 158185, Start Time: 2012-06-08 02:00:42, End Time: 2012-06-08 02:57:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2795, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3691, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0969, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2236, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2418, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5637 => 0.5789, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (13.2842 => 13.6247, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.3819 => 1.4156, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.39% (1.3813 => 1.4143, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9713, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (3.8646 => 3.9533, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.24% (16.6129 => 16.9852, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.78% (1.3693 => 1.3937, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.72% (16.2614 => 16.5411, std. dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0620, std. dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.1007 => 2.1288, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3143, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7122, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6448, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2531, std. dev.: 0.0525) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9996 => 1.0801, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.01% (1.2998 => 1.3909, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.80% (7.4271 => 7.7093, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.22% (1.7688 => 1.8257, std. dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4606, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5903, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1234, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5928 => 4.6594, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.23% (3.2729 => 3.3131, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1790, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.69% (0.4657 => 0.3833, std. dev.: 0.0263) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0141, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.66% (0.3578 => 0.3447, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.3914 => 0.3791, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.32% (1.9828 => 1.9567, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9086, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1179, std. dev.: 0.0252) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8859, std. dev.: 0.0643) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4867 => 0.4763, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5123, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7749, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (4.1080 => 4.0430, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8566, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.09% (8.8259 => 8.7300, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 7 22:41:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 00:41:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608054125.C52442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/959?compare_to=958&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 959, Order: 158192, Start Time: 2012-06-08 04:46:05, End Time: 2012-06-08 05:42:39 To: 958, Order: 158189, Start Time: 2012-06-08 03:23:24, End Time: 2012-06-08 04:20:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.01% (2.0176 => 2.2800, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9199 => 0.9511, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (3.9660 => 4.0981, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.6959 => 0.7184, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3667, std. dev.: 0.0108) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2454, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2192, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5265 => 0.5417, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.71% (0.7710 => 0.7919, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.2842 => 13.6223, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (1.3813 => 1.4154, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.3819 => 1.4144, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (3.8646 => 3.9535, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 2.25% (16.6129 => 16.9864, std. dev.: 0.0213) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.77% (1.3693 => 1.3936, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5235, std. dev.: 0.0177) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0664, std. dev.: 0.0191) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1474, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.1007 => 2.1268, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7143, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3120, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6433, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.64% (1.2998 => 1.3991, std. dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.15% (1.5824 => 1.6956, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7159, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.7688 => 1.8266, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4599, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.93% (11.2619 => 11.5923, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1006, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6625, std. dev.: 0.0089) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.04% (3.2729 => 3.3070, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.86% (0.4657 => 0.3872, std. dev.: 0.0134) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.5627 => 21.0269, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.89% (0.3623 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.47% (0.9108 => 0.8974, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (1.9828 => 1.9613, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9597, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9084, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1127, std. dev.: 0.0177) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9267, std. dev.: 0.0907) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.76% (4.1080 => 4.0357, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7736, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7004, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7820, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 04:10:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 06:10:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608111057.1B6AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/960?compare_to=959&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 960, Order: 158195, Start Time: 2012-06-08 10:15:31, End Time: 2012-06-08 11:12:10 To: 959, Order: 158192, Start Time: 2012-06-08 04:46:05, End Time: 2012-06-08 05:42:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2795, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.65% (0.9199 => 0.9535, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1045, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.3245 => 1.3703, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.0594 => 1.0953, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.04% (13.8202 => 14.2409, std. dev.: 0.0101) MultiSource/Applications/siod/siod: 3.02% (2.1791 => 2.2449, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (13.2842 => 13.6354, std. dev.: 0.0146) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.7710 => 0.7905, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 2.47% (16.6129 => 17.0236, std. dev.: 0.0194) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (3.8646 => 3.9573, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.36% (1.9270 => 1.9725, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.3813 => 1.4139, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.4563 => 1.4902, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7038 => 0.7201, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.3819 => 1.4137, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5577 => 0.5698, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.15% (1.3693 => 1.3988, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5446, std. dev.: 0.0183) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0972, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (1.2749 => 1.2939, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1333 => 1.1492, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.1007 => 2.1301, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7193, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (6.5754 => 6.6556, std. dev.: 0.0090) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2218, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2532, std. dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4020, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7220, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.33% (1.7688 => 1.8277, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4605, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.94% (11.2619 => 11.5925, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1116, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9582, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6617, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.20% (3.2729 => 3.3122, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0229, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.6576 => 0.6447, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.42% (0.9108 => 0.8979, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -3.48% (1.9762 => 1.9074, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1138, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9575, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9348, std. dev.: 0.0372) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (4.1080 => 4.0376, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7754, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7820, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.8259 => 8.7058, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 08:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 10:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608150433.ACE1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/961?compare_to=960&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 961, Order: 158199, Start Time: 2012-06-08 14:09:19, End Time: 2012-06-08 15:05:48 To: 960, Order: 158195, Start Time: 2012-06-08 10:15:31, End Time: 2012-06-08 11:12:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.62% (2.0176 => 2.2924, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1035, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9199 => 0.9511, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.6959 => 0.7190, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3676, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.05% (13.8202 => 14.2416, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2424, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.66% (13.2842 => 13.6376, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.7710 => 0.7910, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.55% (1.4563 => 1.4934, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0060, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 2.34% (1.3693 => 1.4014, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.25% (1.3813 => 1.4124, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9702, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.3819 => 1.4127, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9497, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.76% (14.8535 => 15.1156, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5037, std. dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7196, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (6.5754 => 6.6634, std. dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.2742 => 3.3127, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2260, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9996 => 1.0831, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0127) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7244, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.07% (12.0921 => 12.4631, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.95% (11.2619 => 11.5936, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1229, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5928 => 4.6640, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.19% (3.2729 => 3.3119, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.30% (0.4657 => 0.3572, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.5627 => 21.0339, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.44% (0.3511 => 0.3320, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.6250 => 0.6113, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.31% (1.9762 => 1.9108, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1140, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.37% (20.3410 => 19.8580, std. dev.: 0.0651) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9559, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5112, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.1080 => 4.0384, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7747, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2598, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7824, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.33% (8.8259 => 8.7082, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 10:04:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 12:04:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608170441.47D902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/962?compare_to=961&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 962, Order: 158206, Start Time: 2012-06-08 16:09:15, End Time: 2012-06-08 17:05:55 To: 961, Order: 158199, Start Time: 2012-06-08 14:09:19, End Time: 2012-06-08 15:05:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2707, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0985, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.9199 => 0.9496, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.3245 => 1.3654, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.7710 => 0.7916, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1834, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.56% (2.1791 => 2.2348, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4138, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4136, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5740, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9489, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.04% (16.6129 => 16.9515, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9659, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3933, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0439, std. dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4569, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6692 => 3.7127, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1333 => 1.1458, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6453, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0540) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.33% (0.9996 => 1.0829, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1875, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6947, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7216, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8289, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4605, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5909, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.16% (7.9275 => 8.0985, std. dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6625, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.16% (3.2729 => 3.3108, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.49% (0.4657 => 0.3656, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8761, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.27% (0.3511 => 0.3326, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9599, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.49% (1.9762 => 1.9073, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1239, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9135, std. dev.: 0.0430) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (4.1080 => 4.0424, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7737, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.56% (8.8259 => 8.6883, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.37% (9.9194 => 9.7834, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 11:27:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 13:27:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608182715.DDCEC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/963?compare_to=962&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 963, Order: 158211, Start Time: 2012-06-08 17:32:04, End Time: 2012-06-08 18:28:30 To: 962, Order: 158206, Start Time: 2012-06-08 16:09:15, End Time: 2012-06-08 17:05:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.83% (2.0176 => 2.2563, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.6959 => 0.7181, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (3.9660 => 4.0914, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3642, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.7710 => 0.7929, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1840, std. dev.: 0.0142) MultiSource/Applications/siod/siod: 2.58% (2.1791 => 2.2354, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9692, std. dev.: 0.0268) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9467, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.10% (1.1061 => 1.1293, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9671, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (13.2842 => 13.5588, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 1.83% (1.3693 => 1.3944, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.73% (1.3813 => 1.4052, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0174, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7093, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9996 => 1.0791, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6953, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7261, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8280, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4604, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.91% (11.2619 => 11.5896, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.08% (7.9275 => 8.0924, std. dev.: 0.0200) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.66% (0.8273 => 0.8410, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5928 => 4.6587, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.24% (1.2308 => 1.2461, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.16% (3.2729 => 3.3110, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.69% (0.4657 => 0.3740, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8713, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.08% (33.2944 => 32.9349, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0133) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -3.47% (1.9762 => 1.9076, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1131, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9581, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9167, std. dev.: 0.0743) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (4.1080 => 4.0414, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7743, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6990, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7826, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 12:49:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 14:49:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608194959.DC33C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/964?compare_to=963&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 964, Order: 158214, Start Time: 2012-06-08 18:54:40, End Time: 2012-06-08 19:51:14 To: 963, Order: 158211, Start Time: 2012-06-08 17:32:04, End Time: 2012-06-08 18:28:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2786, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1035, std. dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.6959 => 0.7199, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.29% (1.3245 => 1.3681, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2283, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2384, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.7710 => 0.7904, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6082, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1364 => 1.1632, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.30% (16.6129 => 16.9956, std. dev.: 0.0244) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (3.8646 => 3.9526, std. dev.: 0.0168) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.19% (1.4563 => 1.4882, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.16% (1.9270 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4111, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.97% (1.3693 => 1.3963, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7144, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 1.23% (14.8535 => 15.0357, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4284, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6415, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0503) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9996 => 1.0764, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7207, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.32% (1.7688 => 1.8275, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.05% (12.0921 => 12.4608, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.96% (11.2619 => 11.5957, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.05% (7.9275 => 8.0899, std. dev.: 0.0229) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6607, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.19% (3.2729 => 3.3119, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1788, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.38% (22.5627 => 20.8986, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.6576 => 0.6463, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4003, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.44% (1.9762 => 1.9083, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: -2.54% (9.3358 => 9.0991, std. dev.: 0.0381) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9579, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8932, std. dev.: 0.0748) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.72% (4.1080 => 4.0375, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7760, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6985, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7826, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 14:12:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 16:12:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608211239.6D57E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/965?compare_to=964&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 965, Order: 158223, Start Time: 2012-06-08 20:17:23, End Time: 2012-06-08 21:13:54 To: 964, Order: 158214, Start Time: 2012-06-08 18:54:40, End Time: 2012-06-08 19:51:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2784, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.6959 => 0.7211, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1039, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.17% (1.3245 => 1.3665, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2212, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.7710 => 0.7929, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2406, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.2842 => 13.6057, std. dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.31% (16.6129 => 16.9970, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (3.8646 => 3.9529, std. dev.: 0.0094) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.22% (1.9270 => 1.9697, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.03% (1.3813 => 1.4093, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (1.3819 => 1.4098, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.93% (1.3693 => 1.3957, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0445, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4685, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7149, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6462, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.74% (1.8175 => 2.2489, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/mandel-2: 8.74% (1.2998 => 1.4134, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (1.5824 => 1.6949, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7231, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9184, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.23% (1.7688 => 1.8260, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4596, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.92% (11.2619 => 11.5913, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1089, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6637, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9541, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1803, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.25% (0.4657 => 0.3807, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8849, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.29% (0.8818 => 0.8528, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9089, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.30% (9.3358 => 9.1210, std. dev.: 0.0366) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9577, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9750, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.72% (4.1080 => 4.0374, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7726, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (9.9194 => 9.7825, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.25% (8.8259 => 8.7159, std. dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 15:35:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 17:35:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608223532.576822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/966?compare_to=965&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 966, Order: 158226, Start Time: 2012-06-08 21:40:04, End Time: 2012-06-08 22:36:46 To: 965, Order: 158223, Start Time: 2012-06-08 20:17:23, End Time: 2012-06-08 21:13:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (75 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (1.9771 => 2.0006, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.2348 => 1.2488, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.01% (1.3957 => 1.4098, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.36% (2.0176 => 2.2871, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9199 => 0.9557, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (3.9660 => 4.1195, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.79% (1.0594 => 1.0995, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 3.36% (13.8202 => 14.2850, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3687, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 3.33% (0.8310 => 0.8587, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.4328 => 0.4465, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.2193 => 1.2559, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 2.96% (1.3693 => 1.4098, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2435, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (13.2842 => 13.6620, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.7710 => 0.7928, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.71% (16.6129 => 17.0626, std. dev.: 0.0090) MultiSource/Applications/treecc/treecc: 2.59% (1.9270 => 1.9769, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.7460 => 0.7651, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.54% (1.3819 => 1.4170, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.4563 => 1.4932, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.47% (1.1061 => 1.1334, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (3.8646 => 3.9581, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.7038 => 0.7208, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4144, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7393, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.83% (14.8535 => 15.1248, std. dev.: 0.0123) MultiSource/Applications/spiff/spiff: 1.79% (0.7506 => 0.7640, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2292 => 1.2488, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.51% (6.5754 => 6.6749, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5011, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.43% (3.2742 => 3.3211, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.33% (3.1889 => 3.2312, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2940, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.5188 => 1.5346, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2551, std. dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.10% (2.0200 => 2.1836, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (1.5824 => 1.6952, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.97% (1.2998 => 1.3904, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7210, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0921 => 12.4603, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.95% (11.2619 => 11.5941, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1092, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5184 => 0.5287, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6637, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.20% (3.2729 => 3.3123, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.47% (0.4657 => 0.3797, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0451, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.26% (0.8818 => 0.8619, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.0460 => 0.9496, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9600, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.46% (1.9762 => 1.9079, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1087, std. dev.: 0.0179) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4867 => 0.4760, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9698, std. dev.: 0.0338) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.63% (4.1080 => 4.0411, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7745, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.37% (9.9194 => 9.7831, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.23% (8.8259 => 8.7170, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 16:58:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 18:58:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120608235815.E6F7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/967?compare_to=966&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 967, Order: 158234, Start Time: 2012-06-08 23:02:57, End Time: 2012-06-08 23:59:30 To: 966, Order: 158226, Start Time: 2012-06-08 21:40:04, End Time: 2012-06-08 22:36:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.32% (2.0006 => 1.9742, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -1.13% (1.2488 => 1.2347, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.09% (2.0176 => 2.2818, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (0.9199 => 0.9527, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1056, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.51% (0.6959 => 0.7203, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.18% (13.8202 => 14.2598, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3656, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.87% (2.1791 => 2.2417, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.7710 => 0.7928, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0495, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.50% (1.3693 => 1.4036, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6133, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.38% (1.1061 => 1.1324, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9546, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 2.28% (1.9270 => 1.9710, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.24% (0.7038 => 0.7196, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.17% (1.3813 => 1.4113, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (1.3819 => 1.4103, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0662, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7208, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4498, std. dev.: 0.0147) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (6.5754 => 6.6483, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1231, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0497) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.09% (0.9996 => 1.0805, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.10% (1.5824 => 1.6948, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7119, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.28% (1.7688 => 1.8268, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.06% (12.0921 => 12.4616, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.96% (11.2619 => 11.5947, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (7.9275 => 8.1016, std. dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5928 => 4.6646, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.20% (3.2729 => 3.3123, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5716, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.17% (0.4657 => 0.3671, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9873, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.17% (0.3601 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.06% (0.3663 => 0.3551, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.04% (0.3646 => 0.3535, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.72% (0.3789 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.72% (0.3940 => 0.3833, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -2.55% (0.3914 => 0.3814, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.14% (0.6250 => 0.6116, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.21% (1.0460 => 0.9497, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.64% (6.2497 => 5.9598, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4112, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9095, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1111, std. dev.: 0.0150) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9599, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0029, std. dev.: 0.0615) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (4.1080 => 4.0414, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7739, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.50% (8.8259 => 8.6936, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (9.9194 => 9.7819, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 18:21:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 20:21:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609012103.0B9F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/968?compare_to=967&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 968, Order: 158245, Start Time: 2012-06-09 00:25:46, End Time: 2012-06-09 01:22:17 To: 967, Order: 158234, Start Time: 2012-06-08 23:02:57, End Time: 2012-06-08 23:59:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (72 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (4.0414 => 4.1898, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 1.47% (2.2645 => 2.2978, std. dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (0.9497 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.6936 => 8.5757, std. dev.: 0.0091) MultiSource/Applications/lua/lua: -1.02% (26.4630 => 26.1934, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2707, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.93% (0.2596 => 0.2698, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.9199 => 0.9538, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (3.9660 => 4.1077, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.26% (2.1791 => 2.2501, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2644, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1286, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.72% (0.7710 => 0.7920, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (3.8646 => 3.9685, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.58% (1.1061 => 1.1346, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.7038 => 0.7214, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6138, std. dev.: 0.0144) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9738, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.43% (0.4328 => 0.4433, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4900, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.28% (1.3693 => 1.4005, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.3813 => 1.4115, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4096, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.63% (0.7506 => 0.7628, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7228, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0621, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.1007 => 2.1289, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4777, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6521, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.14% (3.1889 => 3.2253, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.2742 => 3.3102, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.43% (1.8175 => 2.2978, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.90% (1.2998 => 1.4025, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7225, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5193, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.92% (7.9275 => 8.1590, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.77% (1.9199 => 1.9730, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.28% (10.7476 => 10.8852, std. dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2308 => 1.2445, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.16% (0.4657 => 0.3718, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0283, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.8818 => 0.8550, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -2.82% (0.3623 => 0.3521, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.86% (0.6250 => 0.6134, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5757, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9554, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -2.26% (9.3358 => 9.1248, std. dev.: 0.0285) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (20.3410 => 19.9038, std. dev.: 0.0246) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4997, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6977, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0209) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2616, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1934, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 19:43:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 21:43:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609024342.ABB3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/969?compare_to=968&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 969, Order: 158254, Start Time: 2012-06-09 01:48:26, End Time: 2012-06-09 02:44:56 To: 968, Order: 158245, Start Time: 2012-06-09 00:25:46, End Time: 2012-06-09 01:22:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2809, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (3.9660 => 4.1072, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3245 => 1.3674, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.12% (2.1791 => 2.2471, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.03% (13.8202 => 14.2391, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.93% (0.7710 => 0.7936, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.86% (16.6129 => 17.0880, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.79% (3.8646 => 3.9723, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6192, std. dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7038 => 0.7215, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.34% (1.9270 => 1.9721, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.29% (1.3813 => 1.4129, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4891, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.15% (1.3693 => 1.3988, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4114, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.45% (0.7506 => 0.7615, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0663, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (3.6692 => 3.7206, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4506, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6499, std. dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7379, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5155, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-6: 3.04% (1.9199 => 1.9783, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1349, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.27% (1.9290 => 1.9535, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.2308 => 1.2442, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.16% (0.4657 => 0.3718, std. dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9235, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0203) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -2.25% (9.3358 => 9.1255, std. dev.: 0.0328) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9153, std. dev.: 0.0560) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6973, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5118, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1678, std. dev.: 0.0525) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 21:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 8 Jun 2012 23:06:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609040620.968772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/970?compare_to=969&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 970, Order: 158256, Start Time: 2012-06-09 03:11:06, End Time: 2012-06-09 04:07:35 To: 969, Order: 158254, Start Time: 2012-06-09 01:48:26, End Time: 2012-06-09 02:44:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2716, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0954, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3675, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0594 => 1.0921, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.00% (2.1791 => 2.2444, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.76% (0.7710 => 0.7923, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1950, std. dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0292, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.48% (3.8646 => 3.9603, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.22% (1.9270 => 1.9697, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (13.2842 => 13.5687, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4859, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.80% (1.3693 => 1.3940, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.62% (1.3819 => 1.4043, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.61% (1.3813 => 1.4035, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0351, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7139, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.2749 => 1.2880, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2748, std. dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.75% (1.2998 => 1.3876, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7341, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.90% (7.9275 => 8.1577, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.29% (0.4657 => 0.3712, std. dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.55% (22.5627 => 20.8591, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.62% (0.6250 => 0.6086, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.07% (33.2944 => 32.9384, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1153, std. dev.: 0.0107) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9581, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6973, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9680, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.73% (0.8342 => 0.8198, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2498, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.5254 => 2.4862, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1833, std. dev.: 0.0303) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 8 22:29:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 00:29:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609052904.82AE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/971?compare_to=970&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 971, Order: 158259, Start Time: 2012-06-09 04:33:48, End Time: 2012-06-09 05:30:19 To: 970, Order: 158256, Start Time: 2012-06-09 03:11:06, End Time: 2012-06-09 04:07:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9199 => 0.9499, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0930, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2392, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1698, std. dev.: 0.0169) MultiSource/Applications/kimwitu++/kc: 2.47% (16.6129 => 17.0236, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.7710 => 0.7898, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9549, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2469, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.19% (1.1061 => 1.1303, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1610, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.11% (1.9270 => 1.9676, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5357, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 1.69% (1.3693 => 1.3925, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.3819 => 1.4044, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.74% (0.9996 => 1.0770, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.25% (7.4271 => 7.7426, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5866, std. dev.: 0.0322) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1542, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.72% (22.5627 => 20.8215, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -2.82% (0.3623 => 0.3521, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.13% (0.9108 => 0.8914, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.04% (0.6576 => 0.6442, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (4.9865 => 4.9346, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5909, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1160, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9594, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9464, std. dev.: 0.0238) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1360, std. dev.: 0.0257) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 04:37:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 06:37:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609113701.3DAE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/972?compare_to=971&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 972, Order: 158263, Start Time: 2012-06-09 10:41:37, End Time: 2012-06-09 11:38:16 To: 971, Order: 158259, Start Time: 2012-06-09 04:33:48, End Time: 2012-06-09 05:30:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2681, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.23% (0.7710 => 0.7959, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.84% (2.1791 => 2.2410, std. dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1731, std. dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.51% (3.8646 => 3.9617, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0300, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2474, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.28% (1.1061 => 1.1313, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1364 => 1.1611, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 2.03% (1.9270 => 1.9662, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5418, std. dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (0.7038 => 0.7169, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.68% (1.3693 => 1.3923, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4043, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4034, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0081, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0489) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4093, std. dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.44% (1.5824 => 1.7002, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7223, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5192, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8280, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1398, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.07% (4.1080 => 4.1931, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.70% (22.5627 => 20.8255, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: -2.76% (0.3623 => 0.3523, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.98% (0.9108 => 0.8928, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5797, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1105, std. dev.: 0.0268) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9091, std. dev.: 0.0533) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1375, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 05:59:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 07:59:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609125944.E04F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/973?compare_to=972&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 973, Order: 158265, Start Time: 2012-06-09 12:04:32, End Time: 2012-06-09 13:01:00 To: 972, Order: 158263, Start Time: 2012-06-09 10:41:37, End Time: 2012-06-09 11:38:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (2.0176 => 2.2612, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.51% (0.6959 => 0.7203, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0953, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0594 => 1.0921, std. dev.: 0.0071) MultiSource/Applications/siod/siod: 3.06% (2.1791 => 2.2458, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1877, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 2.54% (16.6129 => 17.0343, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.7710 => 0.7904, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9609, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.2842 => 13.5862, std. dev.: 0.0144) MultiSource/Applications/treecc/treecc: 2.19% (1.9270 => 1.9692, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7038 => 0.7191, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4098, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.4563 => 1.4860, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (1.3819 => 1.4100, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3932, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0388, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4567, std. dev.: 0.0295) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7118, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std. dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9996 => 1.0808, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7291, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.75% (7.9275 => 8.1452, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.22% (1.2308 => 1.2458, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9513, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.49% (0.4657 => 0.3563, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.55% (22.5627 => 20.8586, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.54% (0.3940 => 0.3840, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.6576 => 0.6476, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6052, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1149, std. dev.: 0.0384) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9372, std. dev.: 0.0181) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2590, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1618, std. dev.: 0.0237) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 07:23:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 09:23:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609142351.112712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/974?compare_to=973&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 974, Order: 158270, Start Time: 2012-06-09 13:28:32, End Time: 2012-06-09 14:25:06 To: 973, Order: 158265, Start Time: 2012-06-09 12:04:32, End Time: 2012-06-09 13:01:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2687, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0954, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2419, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.7710 => 0.7924, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1737, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (3.8646 => 3.9565, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0058, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.1364 => 1.1631, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5920, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4874, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1295, std. dev.: 0.0080) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9668, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4076, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.86% (1.3819 => 1.4076, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.63% (1.3693 => 1.3916, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0312, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7122, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4513, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1456, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.06% (1.2749 => 1.2884, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2713, std. dev.: 0.0420) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.52% (1.2998 => 1.3846, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7194, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5190, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5870, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1264, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.07% (1.9290 => 1.9497, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.21% (0.4657 => 0.3576, std. dev.: 0.0354) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8571, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.40% (0.3940 => 0.3806, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -2.95% (0.4003 => 0.3885, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1168, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.47% (20.3410 => 20.0424, std. dev.: 0.0328) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1390, std. dev.: 0.0440) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 08:46:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 10:46:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609154628.E21182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/975?compare_to=974&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 975, Order: 158274, Start Time: 2012-06-09 14:51:16, End Time: 2012-06-09 15:47:44 To: 974, Order: 158270, Start Time: 2012-06-09 13:28:32, End Time: 2012-06-09 14:25:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (64 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.68% (1.3846 => 1.4078, std. dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.44% (2.0176 => 2.2686, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.6959 => 0.7198, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0935, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3648, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2418, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1727, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5923, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (3.8646 => 3.9542, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 2.24% (16.6129 => 16.9851, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0087) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9671, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.3819 => 1.4101, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4076, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.62% (1.3693 => 1.3915, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4650, std. dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0306, std. dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2890, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7095, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.31% (1.2998 => 1.4078, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.15% (0.9996 => 1.0811, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7204, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.85% (7.9275 => 8.1532, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.2308 => 1.2456, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.47% (0.4657 => 0.3657, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8707, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3623 => 0.3467, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.14% (0.3601 => 0.3452, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: -4.08% (0.3578 => 0.3432, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.60% (0.3940 => 0.3798, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4003 => 0.3870, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6250 => 0.6076, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.9828 => 1.9612, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0150) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5815, std. dev.: 0.0148) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1132, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9572, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6971, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0076, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1509, std. dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 10:09:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 12:09:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609170906.2AE472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/976?compare_to=975&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 976, Order: 158276, Start Time: 2012-06-09 16:13:51, End Time: 2012-06-09 17:10:21 To: 975, Order: 158274, Start Time: 2012-06-09 14:51:16, End Time: 2012-06-09 15:47:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 3.28% (0.3657 => 0.3777, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.40% (2.0176 => 2.2677, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1057, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.3245 => 1.3654, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2446, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.7710 => 0.7926, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1994, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9612, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.1364 => 1.1636, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.38% (16.6129 => 17.0089, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.2842 => 13.5962, std. dev.: 0.0119) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0058) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9679, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.99% (1.3819 => 1.4094, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.77% (1.3693 => 1.3936, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.57% (0.7506 => 0.7624, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7162, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0433, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4576, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.1333 => 1.1463, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2895, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0391) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 7.88% (1.2998 => 1.4022, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7288, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5837, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1296, std. dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.13% (10.7476 => 10.8692, std. dev.: 0.0190) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.90% (0.4657 => 0.3777, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.49% (22.5627 => 20.8722, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.18% (0.3650 => 0.3534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.01% (0.3789 => 0.3675, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4003 => 0.3898, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1157, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9393, std. dev.: 0.0358) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6992, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2507, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1041, std. dev.: 0.0627) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 11:31:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 13:31:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609183151.AD27C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/977?compare_to=976&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 977, Order: 158279, Start Time: 2012-06-09 17:36:33, End Time: 2012-06-09 18:33:07 To: 976, Order: 158276, Start Time: 2012-06-09 16:13:51, End Time: 2012-06-09 17:10:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.25% (2.0176 => 2.2647, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1084, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9199 => 0.9529, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3679, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0594 => 1.0936, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2493, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9727, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2064, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.7710 => 0.7909, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 2.55% (16.6129 => 17.0367, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (13.2842 => 13.6218, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.50% (1.1364 => 1.1648, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4152, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4147, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.34% (1.9270 => 1.9721, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.4563 => 1.4902, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.86% (1.3693 => 1.3948, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.51% (0.7506 => 0.7619, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.39% (14.8535 => 15.0593, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7199, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4629, std. dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6512, std. dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7193, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9622, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1347, std. dev.: 0.0208) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.2308 => 1.2457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std. dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9466, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.00% (0.3601 => 0.3493, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.74% (0.3650 => 0.3550, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.35% (0.6250 => 0.6103, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.50% (1.9762 => 1.9071, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5861, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.12% (9.3358 => 9.1380, std. dev.: 0.0181) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4999, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9511, std. dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6959, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2595, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4882, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1760, std. dev.: 0.0221) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 14:39:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 16:39:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609213959.6AC772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/978?compare_to=977&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 978, Order: 158282, Start Time: 2012-06-09 20:44:40, End Time: 2012-06-09 21:41:15 To: 977, Order: 158279, Start Time: 2012-06-09 17:36:33, End Time: 2012-06-09 18:33:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.30% (2.0176 => 2.2658, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (3.9660 => 4.1113, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.9199 => 0.9531, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.3245 => 1.3682, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.87% (0.7710 => 0.7931, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.85% (13.8202 => 14.2134, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9718, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0601, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.53% (1.1061 => 1.1341, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6192, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4157, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.37% (1.9270 => 1.9727, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.3813 => 1.4139, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7038 => 0.7201, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.48% (0.7506 => 0.7617, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.8535 => 15.0625, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.35% (3.6692 => 3.7189, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4539, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6495, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.96% (1.8175 => 2.3075, std. dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4076, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7364, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1258, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.05% (0.4657 => 0.3956, std. dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9437, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.81% (0.3663 => 0.3560, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.79% (0.3650 => 0.3548, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.0460 => 0.8624, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1180, std. dev.: 0.0276) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7007, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9796, std. dev.: 0.0408) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.40% (6.3560 => 6.2670, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1556, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 16:40:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 18:40:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120609234049.0F4202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/979?compare_to=978&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 979, Order: 158283, Start Time: 2012-06-09 22:45:28, End Time: 2012-06-09 23:42:04 To: 978, Order: 158282, Start Time: 2012-06-09 20:44:40, End Time: 2012-06-09 21:41:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.38% (2.0176 => 2.2673, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.6959 => 0.7201, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1038, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3679, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.04% (0.8310 => 0.8563, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5637 => 0.5807, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2435, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.7710 => 0.7932, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1942, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (13.2842 => 13.6429, std. dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.2193 => 1.2516, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.59% (1.3813 => 1.4171, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3819 => 1.4176, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.58% (1.1364 => 1.1657, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9631, std. dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 2.47% (16.6129 => 17.0226, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4916, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 2.35% (1.9270 => 1.9723, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5577 => 0.5705, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (0.7038 => 0.7177, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.92% (1.3693 => 1.3956, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0859, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (3.6692 => 3.7256, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4792, std. dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6596, std. dev.: 0.0135) MultiSource/Applications/d/make_dparser: 1.08% (3.1889 => 3.2233, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9996 => 1.0808, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7297, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0375) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1277, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1929, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.05% (0.4657 => 0.3770, std. dev.: 0.0334) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9331, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3623 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3646 => 0.3536, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.95% (0.3663 => 0.3555, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.85% (0.3650 => 0.3546, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -2.74% (0.3940 => 0.3832, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.69% (0.3789 => 0.3687, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.55% (0.3914 => 0.3814, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.42% (0.8818 => 0.8605, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.34% (0.6250 => 0.6104, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.04% (0.6576 => 0.6442, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5895, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1084, std. dev.: 0.0369) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9569, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6985, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5119, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9933, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1416, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2559, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 18:03:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 20:03:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610010358.2543C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/980?compare_to=979&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 980, Order: 158285, Start Time: 2012-06-10 00:08:33, End Time: 2012-06-10 01:05:14 To: 979, Order: 158283, Start Time: 2012-06-09 22:45:28, End Time: 2012-06-09 23:42:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (2.0176 => 2.2806, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (3.9660 => 4.1131, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9199 => 0.9529, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.53% (1.0594 => 1.0968, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.3245 => 1.3694, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2453, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2322, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.2193 => 1.2544, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.66% (13.2842 => 13.6382, std. dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 2.62% (3.8646 => 3.9658, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.57% (1.1061 => 1.1345, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0381, std. dev.: 0.0244) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.48% (1.9270 => 1.9747, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.4563 => 1.4922, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.3819 => 1.4152, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (0.7038 => 0.7198, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.13% (1.3693 => 1.3985, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.6692 => 3.7343, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 1.63% (14.8535 => 15.0951, std. dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1333 => 1.1507, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.40% (0.7506 => 0.7611, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.36% (16.2614 => 16.4828, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (3.2742 => 3.3167, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6595, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2281, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5348, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.35% (1.5824 => 1.6987, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5838, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1397, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (0.5184 => 0.5289, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9799, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: -3.37% (0.3623 => 0.3501, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.32% (0.3650 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.14% (0.3663 => 0.3548, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -2.92% (0.3940 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4003 => 0.3903, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.31% (0.8818 => 0.8614, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.24% (0.9108 => 0.8995, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5758, std. dev.: 0.0185) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.23% (9.3358 => 9.1279, std. dev.: 0.0272) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7021, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0103, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0094) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1751, std. dev.: 0.0243) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 19:26:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 21:26:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610022642.29CA82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/981?compare_to=980&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 981, Order: 158286, Start Time: 2012-06-10 01:31:23, End Time: 2012-06-10 02:27:57 To: 980, Order: 158285, Start Time: 2012-06-10 00:08:33, End Time: 2012-06-10 01:05:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (772 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.43% (3.6873 => 3.7401, std. dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2814, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (3.9660 => 4.1149, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9199 => 0.9533, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.3245 => 1.3690, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.18% (2.1791 => 2.2484, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5637 => 0.5808, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2285, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.87% (0.7710 => 0.7931, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.2193 => 1.2537, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (3.8646 => 3.9667, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0500, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (13.2842 => 13.6279, std. dev.: 0.0162) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1338, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (1.3813 => 1.4154, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4157, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9739, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5577 => 0.5705, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.91% (1.3693 => 1.3955, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.50% (3.6692 => 3.7241, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 1.49% (14.8535 => 15.0744, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: 1.43% (0.7506 => 0.7613, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1333 => 1.1493, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4760, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1282, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.2742 => 3.3161, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (6.5754 => 6.6554, std. dev.: 0.0153) MultiSource/Applications/d/make_dparser: 1.08% (3.1889 => 3.2233, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.5188 => 1.5344, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0489) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 7.90% (1.2998 => 1.4025, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7253, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1371, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 1.15% (3.6975 => 3.7401, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.57% (0.4657 => 0.3699, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9511, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3663 => 0.3535, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3646 => 0.3519, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -3.35% (0.3578 => 0.3458, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.99% (0.3914 => 0.3797, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.22% (0.6576 => 0.6430, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5888, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.21% (9.3358 => 9.1298, std. dev.: 0.0280) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9198, std. dev.: 0.0452) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2508, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1645, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 21:13:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 9 Jun 2012 23:13:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610041357.0EB732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/982?compare_to=981&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 982, Order: 158287, Start Time: 2012-06-10 03:18:41, End Time: 2012-06-10 04:15:12 To: 981, Order: 158286, Start Time: 2012-06-10 01:31:23, End Time: 2012-06-10 02:27:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.31% (3.7401 => 3.6911, std. dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.77% (2.0176 => 2.2753, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9199 => 0.9543, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (3.9660 => 4.1118, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.55% (0.5265 => 0.5452, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.3245 => 1.3702, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.7710 => 0.7970, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.33% (2.1791 => 2.2517, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.30% (1.0594 => 1.0944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8310 => 0.8562, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2249, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (3.8646 => 3.9743, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2535, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0641, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.1364 => 1.1671, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (13.2842 => 13.6424, std. dev.: 0.0246) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (1.3819 => 1.4186, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.3813 => 1.4169, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.58% (1.1061 => 1.1346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.39% (1.9270 => 1.9730, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.4563 => 1.4898, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.7038 => 0.7195, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.14% (1.3693 => 1.3986, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.63% (0.7506 => 0.7628, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.55% (3.6692 => 3.7259, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.8535 => 15.0823, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1333 => 1.1500, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4773, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.5754 => 6.6605, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3089, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.00% (3.1889 => 3.2209, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3997, std. dev.: 0.0187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7174, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0354) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1318, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.26% (9.0760 => 9.1908, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9524, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.56% (0.4657 => 0.3653, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9526, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.79% (0.3650 => 0.3548, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.73% (0.8818 => 0.8577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.07% (0.6576 => 0.6440, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.8259 => 8.5627, std. dev.: 0.0194) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1152, std. dev.: 0.0473) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9559, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9471, std. dev.: 0.0325) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4906, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1759, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 9 22:36:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 00:36:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610053639.5A2AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/983?compare_to=982&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 983, Order: 158288, Start Time: 2012-06-10 04:41:22, End Time: 2012-06-10 05:37:55 To: 982, Order: 158287, Start Time: 2012-06-10 03:18:41, End Time: 2012-06-10 04:15:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (782 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2731, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1059, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.3245 => 1.3686, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.17% (2.1791 => 2.2481, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8310 => 0.8562, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.89% (0.7710 => 0.7933, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2009, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (13.2842 => 13.6448, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9654, std. dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 2.57% (16.6129 => 17.0400, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.53% (1.1061 => 1.1341, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.44% (1.3813 => 1.4150, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.3819 => 1.4154, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.28% (1.9270 => 1.9709, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.7038 => 0.7195, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4887, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.7460 => 0.7622, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.14% (1.3693 => 1.3986, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0705, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (3.6692 => 3.7207, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4751, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6519, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3081, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2733, std. dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.20% (0.9996 => 1.0816, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7244, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.80% (7.9275 => 8.1492, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.25% (0.4657 => 0.3807, std. dev.: 0.0314) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9444, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.25% (0.3601 => 0.3484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.18% (0.3650 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.13% (0.3646 => 0.3532, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.91% (0.3578 => 0.3474, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.54% (0.9108 => 0.8968, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5887, std. dev.: 0.0165) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1157, std. dev.: 0.0312) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9355, std. dev.: 0.0474) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6971, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5147, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2581, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1728, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 01:39:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 03:39:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610083919.87DE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/984?compare_to=983&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 984, Order: 158290, Start Time: 2012-06-10 07:43:23, End Time: 2012-06-10 08:40:35 To: 983, Order: 158288, Start Time: 2012-06-10 04:41:22, End Time: 2012-06-10 05:37:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (75 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.78% (1.3969 => 1.4218, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2798, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.89% (0.2596 => 0.2697, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (3.9660 => 4.1173, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5265 => 0.5457, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.3245 => 1.3710, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.49% (2.1791 => 2.2552, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.43% (1.0594 => 1.0957, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.35% (0.7710 => 0.7968, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8310 => 0.8581, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 3.26% (16.6129 => 17.1539, std. dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.25% (0.5637 => 0.5820, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.19% (13.8202 => 14.2614, std. dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (3.8646 => 3.9852, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2193 => 1.2556, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (1.3819 => 1.4220, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.89% (1.3813 => 1.4212, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (13.2842 => 13.6625, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 2.83% (1.1061 => 1.1374, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.79% (1.9270 => 1.9807, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1677, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (0.7038 => 0.7229, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.7460 => 0.7652, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4328 => 0.4434, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.39% (1.3693 => 1.4020, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.35% (1.4563 => 1.4905, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7364, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.79% (0.7506 => 0.7640, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.66% (14.8535 => 15.1006, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.63% (1.1333 => 1.1518, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4975, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.5754 => 6.6681, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.33% (3.1889 => 3.2314, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.15% (7.2180 => 7.3012, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.2742 => 3.3112, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.3801 => 4.4264, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 1.01% (1.2292 => 1.2416, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2663, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/mandel-2: 9.39% (1.2998 => 1.4218, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.96% (0.9996 => 1.0792, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.35% (1.5824 => 1.6987, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7179, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0303) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1304, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.64% (3.7731 => 3.8348, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9582, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0502, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -2.79% (0.3623 => 0.3522, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.74% (0.3650 => 0.3550, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.6250 => 0.6133, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.42% (0.9108 => 0.8979, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.21% (20.3410 => 19.8918, std. dev.: 0.0534) MultiSource/Applications/minisat/minisat: -2.19% (9.3358 => 9.1316, std. dev.: 0.0145) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9607, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6996, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1639, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2549, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 03:02:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 05:02:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610100211.6581D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/985?compare_to=984&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 985, Order: 158293, Start Time: 2012-06-10 09:06:48, End Time: 2012-06-10 10:03:27 To: 984, Order: 158290, Start Time: 2012-06-10 07:43:23, End Time: 2012-06-10 08:40:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 6 (69 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 885 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 2.69% (0.5752 => 0.5907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.69% (0.5844 => 0.6001, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (1.9825 => 2.0274, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7102 => 0.7249, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.43% (1.2416 => 1.2594, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.12% (1.4020 => 1.4177, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.12% (2.2552 => 2.2299, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.00% (3.9852 => 3.9452, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.62% (1.4218 => 1.3987, std. dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4328 => 0.4502, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.53% (1.3693 => 1.4177, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.4062 => 0.4196, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0935, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.6959 => 0.7181, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.5818 => 0.6001, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2197, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 2.77% (0.5748 => 0.5907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.69% (1.2193 => 1.2521, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7061 => 0.7249, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.54% (0.7710 => 0.7906, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.46% (1.2292 => 1.2594, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0179, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.2842 => 13.6067, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.33% (2.1791 => 2.2299, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.9828 => 2.0274, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4105, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4870, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9452, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.08% (1.1061 => 1.1291, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9637, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4082, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0640, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7174, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.19% (16.2614 => 16.4543, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6560, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (6.5754 => 6.6424, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 26.08% (1.8175 => 2.2915, std. dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1926, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7365, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5861, std. dev.: 0.0263) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1461, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.31% (0.4657 => 0.3711, std. dev.: 0.0298) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9836, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.15% (0.8818 => 0.8540, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.82% (0.3650 => 0.3547, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.64% (0.3940 => 0.3836, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0213) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5971, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1165, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9593, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9370, std. dev.: 0.0467) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6977, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4869, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1629, std. dev.: 0.0323) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 05:44:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 07:44:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610124434.9A3022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/986?compare_to=985&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 986, Order: 158294, Start Time: 2012-06-10 11:49:14, End Time: 2012-06-10 12:45:51 To: 985, Order: 158293, Start Time: 2012-06-10 09:06:48, End Time: 2012-06-10 10:03:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2783, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.16% (0.4328 => 0.4508, std. dev.: 0.0050) MultiSource/Applications/hbd/hbd: 3.56% (1.3693 => 1.4180, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 3.27% (0.4062 => 0.4195, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.9199 => 0.9493, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.08% (0.5818 => 0.5997, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3635, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.7710 => 0.7930, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.80% (13.8202 => 14.2069, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/Hello: 2.71% (0.5748 => 0.5904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7061 => 0.7246, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2193 => 1.2511, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7038 => 0.7211, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.2292 => 1.2592, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (13.2842 => 13.6041, std. dev.: 0.0245) MultiSource/Applications/kimwitu++/kc: 2.36% (16.6129 => 17.0055, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2273, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (1.9828 => 2.0266, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4877, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.3819 => 1.4101, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8646 => 3.9430, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (1.3813 => 1.4092, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9636, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.39% (16.2614 => 16.4874, std. dev.: 0.0225) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0592, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7177, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6724, std. dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (6.5754 => 6.6423, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.61% (2.0200 => 2.1939, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.28% (1.2998 => 1.3944, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7399, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.01% (7.9275 => 8.1660, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0372) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1968, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.54% (0.4657 => 0.3840, std. dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9825, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.83% (0.3601 => 0.3499, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: -2.64% (0.3940 => 0.3836, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (0.9108 => 0.8939, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5856, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1190, std. dev.: 0.0140) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9185, std. dev.: 0.0374) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1721, std. dev.: 0.0259) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 13:10:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 15:10:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610201046.555EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/987?compare_to=986&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 987, Order: 158295, Start Time: 2012-06-10 19:15:22, End Time: 2012-06-10 20:12:03 To: 986, Order: 158294, Start Time: 2012-06-10 11:49:14, End Time: 2012-06-10 12:45:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (773 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.11% (0.4328 => 0.4506, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.48% (1.3693 => 1.4170, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.37% (0.4062 => 0.4199, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0989, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3245 => 1.3670, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8310 => 0.8559, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 2.92% (0.5818 => 0.5988, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (13.2842 => 13.6712, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 2.86% (0.7061 => 0.7263, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1953, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.64% (2.1791 => 2.2367, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0493, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.61% (0.7710 => 0.7911, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.59% (0.3899 => 0.4000, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.56% (1.2292 => 1.2607, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.51% (0.5748 => 0.5892, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (1.9828 => 2.0298, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (3.8646 => 3.9504, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.10% (1.9270 => 1.9674, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4091, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0871, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.33% (3.6692 => 3.7180, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (6.5754 => 6.6623, std. dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6514, std. dev.: 0.0321) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.62% (2.0200 => 2.1941, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7316, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.85% (11.2619 => 11.5833, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.80% (7.9275 => 8.1494, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.61% (0.4657 => 0.3697, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.03% (22.5627 => 20.9773, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -3.12% (0.3623 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.05% (0.3601 => 0.3491, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3650 => 0.3540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.96% (0.3646 => 0.3538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.93% (0.3578 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.87% (0.3940 => 0.3827, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -2.72% (0.3789 => 0.3686, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5767, std. dev.: 0.0226) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1147, std. dev.: 0.0423) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9894, std. dev.: 0.0447) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2534, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8568, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1641, std. dev.: 0.0288) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 14:33:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 16:33:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610213336.C47D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/988?compare_to=987&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 988, Order: 158296, Start Time: 2012-06-10 20:38:14, End Time: 2012-06-10 21:34:54 To: 987, Order: 158295, Start Time: 2012-06-10 19:15:22, End Time: 2012-06-10 20:12:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (773 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (2.0176 => 2.2807, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4328 => 0.4492, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9199 => 0.9526, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.54% (1.3693 => 1.4178, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4062 => 0.4204, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (3.9660 => 4.1020, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.5818 => 0.5981, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.7710 => 0.7926, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.79% (1.2193 => 1.2533, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0652, std. dev.: 0.0107) MultiSource/Applications/siod/siod: 2.71% (2.1791 => 2.2382, std. dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (0.7038 => 0.7226, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.67% (13.8202 => 14.1889, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (13.2842 => 13.6349, std. dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2292 => 1.2606, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 2.47% (0.5748 => 0.5890, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 2.39% (0.7061 => 0.7230, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8646 => 3.9557, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.33% (1.1061 => 1.1319, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4900, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (1.9828 => 2.0285, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.16% (1.9270 => 1.9686, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4106, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0976, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 1.51% (16.2614 => 16.5072, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7197, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6543, std. dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6916, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1007 => 2.1234, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3073, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7336, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0203) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1511, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.85% (0.4657 => 0.3686, std. dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9622, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.26% (0.3623 => 0.3505, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.17% (0.3601 => 0.3487, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.13% (0.3646 => 0.3532, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3663 => 0.3552, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.96% (0.3578 => 0.3472, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.87% (0.3940 => 0.3827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.82% (0.3789 => 0.3682, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.6576 => 0.6447, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.48% (0.9108 => 0.8973, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.0460 => 0.8624, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5962, std. dev.: 0.0286) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1171, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6979, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.62% (20.3410 => 20.0114, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4884, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1968, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2540, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 15:56:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 10 Jun 2012 17:56:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120610225628.147FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/989?compare_to=988&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 989, Order: 158297, Start Time: 2012-06-10 22:01:01, End Time: 2012-06-10 22:57:44 To: 988, Order: 158296, Start Time: 2012-06-10 20:38:14, End Time: 2012-06-10 21:34:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (76 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2794, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.70% (1.3693 => 1.4199, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1037, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3675, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.16% (0.5818 => 0.6002, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.4062 => 0.4189, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.94% (0.5748 => 0.5917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.7710 => 0.7935, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.88% (13.8202 => 14.2188, std. dev.: 0.0136) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2419, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0889, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7038 => 0.7238, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.2193 => 1.2539, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7061 => 0.7259, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (13.2842 => 13.6285, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (3.8646 => 3.9635, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.50% (1.2292 => 1.2599, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.4563 => 1.4904, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (1.9828 => 2.0291, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.26% (1.9270 => 1.9706, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4098, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4082, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (3.6692 => 3.7251, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0702, std. dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4958, std. dev.: 0.0419) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3126, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6514, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1240, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0494) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.67% (1.2998 => 1.3865, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7205, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.97% (7.9275 => 8.1626, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5864, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (0.5184 => 0.5290, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.5928 => 4.6470, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8560, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9572, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: -3.34% (0.3623 => 0.3502, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.19% (0.3601 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.19% (0.3578 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.15% (0.3646 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3663 => 0.3550, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.89% (0.3940 => 0.3826, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4003 => 0.3901, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1130, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.35% (8.8259 => 8.6187, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9611, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5121, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9919, std. dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1874, std. dev.: 0.0256) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 10 22:03:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 00:03:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611050359.4575E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/990?compare_to=989&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 990, Order: 158298, Start Time: 2012-06-11 04:08:43, End Time: 2012-06-11 05:05:16 To: 989, Order: 158297, Start Time: 2012-06-10 22:01:01, End Time: 2012-06-10 22:57:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (77 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (771 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4328 => 0.4493, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.72% (1.3693 => 1.4202, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.71% (0.6959 => 0.7217, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1101, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9199 => 0.9526, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.27% (0.4062 => 0.4195, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.24% (0.7710 => 0.7960, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 3.04% (0.5818 => 0.5995, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1051, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 2.96% (0.7038 => 0.7246, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2192, std. dev.: 0.0128) SingleSource/UnitTests/ObjC++/Hello: 2.87% (0.5748 => 0.5913, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.85% (2.1791 => 2.2413, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.2193 => 1.2536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7061 => 0.7259, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (3.8646 => 3.9638, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (13.2842 => 13.6208, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2292 => 1.2601, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.43% (1.1061 => 1.1330, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (1.9828 => 2.0301, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4899, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9713, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (1.3813 => 1.4084, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (3.6692 => 3.7264, std. dev.: 0.0157) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5048, std. dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 1.49% (14.8535 => 15.0745, std. dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3138, std. dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6533, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.1007 => 2.1251, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2778, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1885, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.38% (1.2998 => 1.3957, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7327, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5189, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1408, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5184 => 0.5287, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6435, std. dev.: 0.0081) MultiSource/Benchmarks/llubenchmark/llu: 1.05% (3.7731 => 3.8129, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.31% (0.4657 => 0.3618, std. dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9677, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.25% (0.3601 => 0.3484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3623 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3663 => 0.3552, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -2.92% (0.3940 => 0.3825, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.88% (0.3789 => 0.3680, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5785, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1178, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9605, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9138, std. dev.: 0.0223) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6989, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1484, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 01:36:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 03:36:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611083648.42A832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/991?compare_to=990&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 991, Order: 158300, Start Time: 2012-06-11 07:41:16, End Time: 2012-06-11 08:38:03 To: 990, Order: 158298, Start Time: 2012-06-11 04:08:43, End Time: 2012-06-11 05:05:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2730, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4328 => 0.4498, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9199 => 0.9545, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5265 => 0.5460, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.68% (1.3693 => 1.4197, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1065, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4062 => 0.4188, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.10% (2.1791 => 2.2466, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7038 => 0.7251, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.03% (0.5818 => 0.5994, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8310 => 0.8561, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.3899 => 0.4016, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.7710 => 0.7941, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1063, std. dev.: 0.0257) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2280, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2535, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 2.75% (0.5748 => 0.5906, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1359, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (3.8646 => 3.9687, std. dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1668, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (13.2842 => 13.6356, std. dev.: 0.0120) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2292 => 1.2616, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 2.59% (0.7061 => 0.7244, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5577 => 0.5717, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9752, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.43% (0.7460 => 0.7641, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.9828 => 2.0261, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4113, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7307, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.8535 => 15.0824, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 1.53% (0.7506 => 0.7621, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (6.5754 => 6.6591, std. dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4670, std. dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3150, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 1.11% (3.1889 => 3.2242, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6558, std. dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2941, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0462) SingleSource/Benchmarks/Misc/mandel-2: 8.31% (1.2998 => 1.4078, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7348, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1393, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (0.5184 => 0.5284, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9538, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2459, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6449, std. dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9921, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.59% (0.3940 => 0.3838, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std. dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.74% (20.3410 => 19.7840, std. dev.: 0.0981) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5899, std. dev.: 0.0130) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1120, std. dev.: 0.0340) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4874, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0090) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1589, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2510, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 02:59:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 04:59:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611095945.D78BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/992?compare_to=991&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 992, Order: 158302, Start Time: 2012-06-11 09:04:22, End Time: 2012-06-11 10:01:03 To: 991, Order: 158300, Start Time: 2012-06-11 07:41:16, End Time: 2012-06-11 08:38:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2697, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.66% (0.5818 => 0.6031, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.63% (1.3693 => 1.4190, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4062 => 0.4205, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0990, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 3.29% (0.5748 => 0.5937, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.3245 => 1.3664, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.13% (0.3580 => 0.3692, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.3899 => 0.4018, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.03% (0.7061 => 0.7275, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.98% (0.3485 => 0.3589, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2292 => 1.2650, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.90% (16.6129 => 17.0944, std. dev.: 0.0211) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.7710 => 0.7928, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2406, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (1.9828 => 2.0375, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (0.7038 => 0.7231, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1787, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9628, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2501, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.4016 => 0.4117, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4390 => 0.4497, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.38% (1.1061 => 1.1324, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5971, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9693, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.3819 => 1.4105, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7200, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.25% (33.2944 => 33.7112, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0379, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6416, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.24% (1.8175 => 2.2763, std. dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1897, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3923, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7437, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5165, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.38% (1.7688 => 1.8286, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1210, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6444, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.42% (0.4657 => 0.3799, std. dev.: 0.0260) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9331, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5858, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1119, std. dev.: 0.0406) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9569, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9130, std. dev.: 0.0696) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2572, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1726, std. dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2556, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 04:22:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 06:22:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611112233.EEED52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/993?compare_to=992&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 993, Order: 158305, Start Time: 2012-06-11 10:27:14, End Time: 2012-06-11 11:23:51 To: 992, Order: 158302, Start Time: 2012-06-11 09:04:22, End Time: 2012-06-11 10:01:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.23% (0.4328 => 0.4511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.64% (0.5818 => 0.6030, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.63% (0.2945 => 0.3052, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.55% (1.3693 => 1.4179, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4062 => 0.4206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (3.9660 => 4.0995, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9199 => 0.9505, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.25% (0.5748 => 0.5935, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.3245 => 1.3652, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3485 => 0.3592, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.99% (0.3580 => 0.3687, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.90% (0.7061 => 0.7266, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.3899 => 0.4012, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.2292 => 1.2642, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0829, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2402, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (1.9828 => 2.0366, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7038 => 0.7225, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1786, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.49% (0.4016 => 0.4116, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (3.8646 => 3.9576, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5874, std. dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.28% (0.4390 => 0.4490, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4111, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.3819 => 1.4115, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9679, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0404, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7152, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.23% (1.1333 => 1.1472, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6969, std. dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.55% (1.2998 => 1.3849, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7373, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5842, std. dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1405, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9553, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6451, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.12% (0.4657 => 0.3720, std. dev.: 0.0332) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9355, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: -2.98% (0.3623 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.92% (0.3663 => 0.3556, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.8818 => 0.8563, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -2.88% (0.3578 => 0.3475, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.69% (1.3780 => 1.3272, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5977, std. dev.: 0.0184) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.24% (9.3358 => 9.1268, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9579, std. dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6966, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1253, std. dev.: 0.0479) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 05:45:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 07:45:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611124524.8B7892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/994?compare_to=993&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 994, Order: 158307, Start Time: 2012-06-11 11:50:08, End Time: 2012-06-11 12:46:42 To: 993, Order: 158305, Start Time: 2012-06-11 10:27:14, End Time: 2012-06-11 11:23:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (79 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.72% (1.3849 => 1.4087, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (2.0176 => 2.2693, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.68% (0.5818 => 0.6032, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4062 => 0.4206, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.47% (1.3693 => 1.4168, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.6959 => 0.7200, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (3.9660 => 4.0992, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5748 => 0.5934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.07% (0.3580 => 0.3690, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (1.3245 => 1.3649, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.04% (0.3485 => 0.3591, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.3899 => 0.4013, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7061 => 0.7264, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2292 => 1.2645, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.86% (16.6129 => 17.0887, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.76% (0.7038 => 0.7232, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.71% (2.1791 => 2.2381, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.9828 => 2.0363, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.61% (13.8202 => 14.1813, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.4016 => 0.4118, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (3.8646 => 3.9566, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.35% (1.1061 => 1.1321, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.2842 => 13.5904, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.30% (0.4390 => 0.4491, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9671, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4100, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0490, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7160, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6848, std. dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2667, std. dev.: 0.0471) SingleSource/Benchmarks/Misc/mandel-2: 8.38% (1.2998 => 1.4087, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.26% (0.9996 => 1.0822, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7449, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1466, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 1.27% (1.2308 => 1.2464, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.5928 => 4.6470, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.41% (0.4657 => 0.3660, std. dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9275, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.00% (0.3601 => 0.3493, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.93% (0.3650 => 0.3543, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.92% (0.3663 => 0.3556, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.88% (0.8818 => 0.8564, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -2.88% (0.3646 => 0.3541, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.88% (0.3578 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0158) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1157, std. dev.: 0.0117) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9592, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9953, std. dev.: 0.0194) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0031) MultiSource/Applications/lua/lua: -1.19% (26.5159 => 26.2014, std. dev.: 0.0499) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2549, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 09:00:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 11:00:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611160008.CCA692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/995?compare_to=994&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 995, Order: 158309, Start Time: 2012-06-11 15:04:38, End Time: 2012-06-11 16:01:26 To: 994, Order: 158307, Start Time: 2012-06-11 11:50:08, End Time: 2012-06-11 12:46:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.0176 => 2.2702, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4328 => 0.4499, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.56% (1.3693 => 1.4180, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1006, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.25% (0.4062 => 0.4194, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.25% (0.5818 => 0.6007, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.7710 => 0.7935, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 2.87% (0.5748 => 0.5913, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2402, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.77% (16.6129 => 17.0732, std. dev.: 0.0248) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7038 => 0.7230, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1945, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.64% (0.3899 => 0.4002, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7061 => 0.7247, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2292 => 1.2605, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9611, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (1.9828 => 2.0293, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (13.2842 => 13.5912, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.3819 => 1.4115, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4874, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9669, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0448, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7154, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.1333 => 1.1463, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.2749 => 1.2880, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fbench: 26.83% (1.8175 => 2.3052, std. dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1872, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.54% (1.2998 => 1.3978, std. dev.: 0.0099) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7218, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9222, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5165, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1424, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6432, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9295, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.8818 => 0.8561, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.85% (0.3650 => 0.3546, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6005, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1157, std. dev.: 0.0215) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6995, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.58% (20.3410 => 20.0192, std. dev.: 0.0435) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8561, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.47% (6.3560 => 6.2624, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1765, std. dev.: 0.0273) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2548, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 10:23:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 12:23:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611172302.78D622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/996?compare_to=995&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 996, Order: 158315, Start Time: 2012-06-11 16:27:38, End Time: 2012-06-11 17:24:19 To: 995, Order: 158309, Start Time: 2012-06-11 15:04:38, End Time: 2012-06-11 16:01:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (768 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4328 => 0.4497, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.72% (1.3693 => 1.4203, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1067, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.6959 => 0.7205, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.0594 => 1.0966, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9199 => 0.9518, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4062 => 0.4202, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5265 => 0.5446, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3245 => 1.3673, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.8310 => 0.8566, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.7038 => 0.7249, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2552, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2258, std. dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 2.88% (16.6129 => 17.0906, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 2.85% (0.5818 => 0.5984, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.75% (2.1791 => 2.2391, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.69% (0.3899 => 0.4004, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1669, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (13.2842 => 13.6358, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.7710 => 0.7912, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.62% (1.2292 => 1.2614, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9655, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 2.61% (0.5748 => 0.5898, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (1.4563 => 1.4925, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.45% (0.7061 => 0.7234, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.35% (0.5577 => 0.5708, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.34% (1.3813 => 1.4136, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9715, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (1.9828 => 2.0272, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0911, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7275, std. dev.: 0.0143) MultiSource/Applications/spiff/spiff: 1.52% (0.7506 => 0.7620, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1333 => 1.1489, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.5754 => 6.6600, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4641, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.20% (0.8698 => 0.8802, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2264, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2935, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1225, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0377) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std. dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.86% (7.4271 => 7.7137, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5191, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.16% (7.9275 => 8.1782, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.85% (11.2619 => 11.5834, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6440, std. dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 1.07% (3.7731 => 3.8136, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.85% (0.4657 => 0.3686, std. dev.: 0.0108) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9935, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.50% (0.3511 => 0.3318, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.3623 => 0.3513, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.79% (0.3650 => 0.3548, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.54% (0.3940 => 0.3840, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5737, std. dev.: 0.0224) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1135, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6989, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0064, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/heapsort: -1.58% (3.9173 => 3.8555, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1381, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 11:45:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 13:45:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611184550.6694B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/997?compare_to=996&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 997, Order: 158319, Start Time: 2012-06-11 17:50:31, End Time: 2012-06-11 18:47:08 To: 996, Order: 158315, Start Time: 2012-06-11 16:27:38, End Time: 2012-06-11 17:24:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (766 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.20% (3.7264 => 3.6816, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.45% (2.0176 => 2.2889, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4328 => 0.4499, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.89% (0.2596 => 0.2697, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5265 => 0.5461, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (3.9660 => 4.1122, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9199 => 0.9536, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.62% (1.3693 => 1.4189, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.3245 => 1.3690, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.25% (16.6129 => 17.1535, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash: 3.25% (0.4062 => 0.4194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5637 => 0.5817, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.17% (0.7038 => 0.7261, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.7710 => 0.7954, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.13% (0.3899 => 0.4021, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.11% (2.1791 => 2.2469, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.07% (0.3580 => 0.3690, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2308, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2552, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 2.89% (0.5748 => 0.5914, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9727, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 2.71% (1.2292 => 1.2625, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.7460 => 0.7659, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (1.1364 => 1.1667, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.58% (0.5577 => 0.5721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.56% (0.5818 => 0.5967, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6187, std. dev.: 0.0112) MultiSource/Applications/treecc/treecc: 2.49% (1.9270 => 1.9750, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (1.9828 => 2.0294, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.30% (1.3813 => 1.4131, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.15% (1.3819 => 1.4116, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7061 => 0.7211, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.76% (0.7506 => 0.7638, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0914, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1333 => 1.1509, std. dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7247, std. dev.: 0.0161) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.5754 => 6.6647, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1272, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4653, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2280, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.8698 => 0.8804, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3094, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (7.2180 => 7.2910, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0435) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3781, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7167, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.54% (12.0921 => 12.5197, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.85% (7.9275 => 8.1535, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.10% (0.5184 => 0.5293, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6423, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9888, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3623 => 0.3491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.51% (0.3650 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3663 => 0.3535, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.46% (0.3646 => 0.3520, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.04% (0.3914 => 0.3795, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.25% (9.3358 => 9.1253, std. dev.: 0.0388) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9667, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7033, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.17% (26.5159 => 26.2049, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 14:24:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 16:24:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611212450.182F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/998?compare_to=997&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 998, Order: 158324, Start Time: 2012-06-11 20:29:29, End Time: 2012-06-11 21:26:08 To: 997, Order: 158319, Start Time: 2012-06-11 17:50:31, End Time: 2012-06-11 18:47:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (82 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (763 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.88% (2.0176 => 2.2976, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.08% (0.2596 => 0.2702, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4328 => 0.4498, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (3.9660 => 4.1190, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.9199 => 0.9550, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.67% (0.5265 => 0.5458, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.61% (1.3693 => 1.4188, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.58% (1.0594 => 1.0973, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.3245 => 1.3703, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.36% (0.7710 => 0.7969, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.25% (0.4062 => 0.4194, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.8310 => 0.8564, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2455, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 3.00% (16.6129 => 17.1115, std. dev.: 0.0206) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2303, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.3899 => 0.4014, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2551, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.93% (0.7038 => 0.7244, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.79% (0.3580 => 0.3680, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.75% (3.8646 => 3.9708, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 2.71% (0.5748 => 0.5904, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.60% (1.1061 => 1.1349, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2292 => 1.2606, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.49% (1.9270 => 1.9749, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6136, std. dev.: 0.0200) SingleSource/UnitTests/ObjC++/property-reference-object: 2.46% (0.5818 => 0.5961, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.4563 => 1.4908, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.29% (1.9828 => 2.0283, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (1.3813 => 1.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.15% (0.7061 => 0.7213, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (3.6692 => 3.7366, std. dev.: 0.0088) MultiSource/Applications/spiff/spiff: 1.81% (0.7506 => 0.7642, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0871, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1333 => 1.1505, std. dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (1.2749 => 1.2939, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.30% (6.5754 => 6.6611, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4529, std. dev.: 0.0155) MultiSource/Applications/d/make_dparser: 1.10% (3.1889 => 3.2241, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (7.2180 => 7.2968, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.66% (1.8175 => 2.2839, std. dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.24% (1.2998 => 1.3939, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7335, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.85% (11.2619 => 11.5833, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1110, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8828, std. dev.: 0.0339) MultiSource/Applications/sqlite3/sqlite3: 1.23% (4.5928 => 4.6492, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.74% (0.4657 => 0.4017, std. dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9578, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3646 => 0.3521, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.00% (0.4003 => 0.3883, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5882, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1153, std. dev.: 0.0407) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9590, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9350, std. dev.: 0.0496) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7019, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2580, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1775, std. dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 15:43:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 17:43:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120611224332.768B92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/999?baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 To: (none) Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Added Tests: 880 (0 on baseline) Unchanged Tests: 14 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 15:47:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 17:47:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120611224747.E84C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1000?compare_to=998&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1000, Order: 158328, Start Time: 2012-06-11 21:52:28, End Time: 2012-06-11 22:49:06 To: 998, Order: 158324, Start Time: 2012-06-11 20:29:29, End Time: 2012-06-11 21:26:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (70 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.69% (1.3939 => 1.4174, std. dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.64% (2.0176 => 2.2727, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.49% (0.4328 => 0.4479, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.9199 => 0.9510, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.27% (1.3693 => 1.4141, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0909, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.90% (0.4062 => 0.4180, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (0.7038 => 0.7231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2358, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0163, std. dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 2.38% (13.8202 => 14.1495, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.21% (3.8646 => 3.9499, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5762, std. dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2292 => 1.2560, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.4563 => 1.4854, std. dev.: 0.0069) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9651, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (1.3813 => 1.4082, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (1.9828 => 2.0207, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0398, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7110, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.12% (16.2614 => 16.4436, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.30% (1.8175 => 2.2774, std. dev.: 0.0271) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7409, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5847, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1336, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6457, std. dev.: 0.0078) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2434, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.43% (22.5627 => 20.8856, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5804, std. dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.47% (20.3410 => 19.8377, std. dev.: 0.0403) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1433, std. dev.: 0.0374) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7015, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1938, std. dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 17:10:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 19:10:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612001032.E26DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1001?compare_to=1000&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1001, Order: 158335, Start Time: 2012-06-11 23:15:23, End Time: 2012-06-12 00:11:51 To: 1000, Order: 158328, Start Time: 2012-06-11 21:52:28, End Time: 2012-06-11 22:49:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.93% (2.0176 => 2.2584, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.6959 => 0.7181, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9199 => 0.9488, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.94% (1.3693 => 1.4096, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.86% (0.4062 => 0.4178, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.39% (0.7038 => 0.7206, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.7710 => 0.7893, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2480, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9742, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (3.8646 => 3.9457, std. dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 2.06% (13.8202 => 14.1046, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2292 => 1.2537, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 1.87% (0.5818 => 0.5927, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (1.3813 => 1.4067, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5244, std. dev.: 0.0240) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9617, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.80% (1.1061 => 1.1260, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.79% (1.3819 => 1.4067, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (1.9828 => 2.0180, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.4563 => 1.4815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.49% (0.7061 => 0.7166, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 8.65% (1.2998 => 1.4122, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7234, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.92% (7.9275 => 8.1587, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.09% (4.5928 => 4.6430, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.26% (0.4657 => 0.3667, std. dev.: 0.0243) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.79% (22.5627 => 20.8056, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3623 => 0.3463, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3601 => 0.3447, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -3.96% (0.3789 => 0.3639, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.41% (0.8818 => 0.8517, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.95% (0.9108 => 0.8930, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2103, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (4.9865 => 4.9348, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5966, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1204, std. dev.: 0.0284) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9572, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6970, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0092, std. dev.: 0.0563) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1358, std. dev.: 0.0413) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (0.9692 => 0.9570, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 18:25:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 20:25:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612012522.76DC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1002?compare_to=999&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1002, Order: 158335, Start Time: 2012-06-11 23:11:12, End Time: 2012-06-12 01:26:41 To: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Unchanged Tests: 893 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0041) Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 18:33:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 20:33:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612013309.A8A4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1003?compare_to=1001&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1003, Order: 158340, Start Time: 2012-06-12 00:37:58, End Time: 2012-06-12 01:34:27 To: 1001, Order: 158335, Start Time: 2012-06-11 23:15:23, End Time: 2012-06-12 00:11:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2699, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9199 => 0.9486, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.11% (1.3693 => 1.4119, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (3.9660 => 4.0850, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3623, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.7710 => 0.7909, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4062 => 0.4166, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.7038 => 0.7205, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2306, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9736, std. dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference-object: 2.15% (0.5818 => 0.5943, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9449, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 2.05% (13.8202 => 14.1037, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.01% (1.2292 => 1.2539, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.2842 => 13.5486, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4081, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9620, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/Hello: 1.79% (0.5748 => 0.5851, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.4563 => 1.4819, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.72% (1.1061 => 1.1251, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (1.9828 => 2.0166, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 1.66% (0.7061 => 0.7178, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.03% (1.2998 => 1.3912, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7261, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5187, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5837, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1360, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6442, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.73% (22.5627 => 20.8197, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.47% (0.3511 => 0.3319, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.3914 => 0.3766, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.89% (0.9108 => 0.8936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (4.9865 => 4.9341, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (6.2785 => 6.2133, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5911, std. dev.: 0.0173) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1159, std. dev.: 0.0107) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9569, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4970, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9518, std. dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1549, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 19:55:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 21:55:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612025546.B3C712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1004?compare_to=1003&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1004, Order: 158347, Start Time: 2012-06-12 02:00:36, End Time: 2012-06-12 02:57:05 To: 1003, Order: 158340, Start Time: 2012-06-12 00:37:58, End Time: 2012-06-12 01:34:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.60% (1.3912 => 1.4134, std. dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2689, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (0.4328 => 0.4488, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.6959 => 0.7190, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.16% (1.3693 => 1.4126, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0887, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.86% (0.4062 => 0.4178, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.53% (2.1791 => 2.2343, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7038 => 0.7215, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0220, std. dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.35% (0.7710 => 0.7891, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.22% (1.2292 => 1.2565, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.18% (13.8202 => 14.1213, std. dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9480, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (1.9828 => 2.0250, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 2.10% (0.5818 => 0.5940, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.2842 => 13.5493, std. dev.: 0.0223) MultiSource/Applications/Burg/burg: 1.98% (1.1061 => 1.1280, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4088, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (1.3813 => 1.4066, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9622, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 1.81% (0.5748 => 0.5852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.78% (0.7061 => 0.7187, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.4563 => 1.4817, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.39% (1.8175 => 2.2789, std. dev.: 0.0502) SingleSource/Benchmarks/Misc/mandel-2: 8.74% (1.2998 => 1.4134, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.67% (2.0200 => 2.1952, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7115, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.84% (7.9275 => 8.1523, std. dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.21% (4.5928 => 4.6483, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.2308 => 1.2439, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.62% (0.4657 => 0.3650, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.73% (22.5627 => 20.8189, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.36% (0.6576 => 0.6421, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (4.9865 => 4.9315, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.37% (1.3780 => 1.3178, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1155, std. dev.: 0.0378) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9576, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0031, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1661, std. dev.: 0.0334) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 21:06:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 23:06:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612040647.D3D5C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1005?compare_to=1002&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1005, Order: 158346, Start Time: 2012-06-12 01:52:48, End Time: 2012-06-12 04:08:06 To: 1002, Order: 158335, Start Time: 2012-06-11 23:11:12, End Time: 2012-06-12 01:26:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 1 (1 on baseline) Unchanged Tests: 893 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (2.0896 => 2.0417, std. dev.: 0.0127) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.94% (2.0820 => 2.0417, std. dev.: 0.0127) Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 21:18:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 11 Jun 2012 23:18:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612041833.52AE62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1006?compare_to=1004&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1006, Order: 158348, Start Time: 2012-06-12 03:23:23, End Time: 2012-06-12 04:19:51 To: 1004, Order: 158347, Start Time: 2012-06-12 02:00:36, End Time: 2012-06-12 02:57:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.88% (2.0176 => 2.2573, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9199 => 0.9492, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (3.9660 => 4.0846, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.98% (1.3693 => 1.4101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.81% (0.4062 => 0.4176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7038 => 0.7202, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2473, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2273, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.14% (13.8202 => 14.1156, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.12% (16.6129 => 16.9659, std. dev.: 0.0210) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2292 => 1.2543, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8646 => 3.9429, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (1.9828 => 2.0206, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5331, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.83% (1.3819 => 1.4072, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 1.82% (0.5818 => 0.5924, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9607, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.4563 => 1.4813, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 1.43% (0.7061 => 0.7162, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2794, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.01% (0.9996 => 1.0797, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.20% (1.2998 => 1.3934, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.88% (7.4271 => 7.7151, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5187, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1514, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2459, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6448, std. dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.64% (0.4657 => 0.3696, std. dev.: 0.0138) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.77% (22.5627 => 20.8095, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.00% (0.4003 => 0.3883, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.94% (0.9108 => 0.8931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.24% (4.9865 => 4.9248, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5778, std. dev.: 0.0224) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1145, std. dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.25% (20.3410 => 19.8841, std. dev.: 0.0337) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6986, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4880, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1976, std. dev.: 0.0228) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 22:41:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 00:41:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612054113.1B8682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1007?compare_to=1006&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1007, Order: 158349, Start Time: 2012-06-12 04:45:59, End Time: 2012-06-12 05:42:31 To: 1006, Order: 158348, Start Time: 2012-06-12 03:23:23, End Time: 2012-06-12 04:19:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2735, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.89% (1.3693 => 1.4225, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.74% (0.4328 => 0.4490, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.4062 => 0.4191, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.9199 => 0.9487, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (3.9660 => 4.0891, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3245 => 1.3629, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (1.9828 => 2.0323, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2292 => 1.2597, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.23% (16.6129 => 16.9834, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2275, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.18% (13.8202 => 14.1220, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 2.13% (0.5818 => 0.5942, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5614, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9436, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.3819 => 1.4092, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 1.97% (0.5748 => 0.5861, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.96% (1.1061 => 1.1278, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4840, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 1.84% (0.7061 => 0.7191, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0073, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7063, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.66% (1.8175 => 2.2838, std. dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7323, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5876, std. dev.: 0.0322) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1480, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6440, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.09% (0.4657 => 0.3768, std. dev.: 0.0179) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.68% (22.5627 => 20.8299, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.99% (0.9108 => 0.8927, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (4.9865 => 4.9314, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0161) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5965, std. dev.: 0.0187) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -2.18% (9.3358 => 9.1323, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9424, std. dev.: 0.1043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2618, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0133) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2414, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 11 23:48:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 01:48:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612064826.8E6AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1008?compare_to=1005&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1008, Order: 158349, Start Time: 2012-06-12 04:34:23, End Time: 2012-06-12 06:49:45 To: 1005, Order: 158346, Start Time: 2012-06-12 01:52:48, End Time: 2012-06-12 04:08:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Unchanged Tests: 893 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.2260 => 0.2396, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.38% (2.8036 => 2.8422, std. dev.: 0.0050) Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 00:06:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 02:06:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612070615.8E4E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1009?compare_to=1007&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1009, Order: 158350, Start Time: 2012-06-12 06:08:43, End Time: 2012-06-12 07:07:33 To: 1007, Order: 158349, Start Time: 2012-06-12 04:45:59, End Time: 2012-06-12 05:42:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.30% (2.0176 => 2.2658, std. dev.: 0.0497) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4328 => 0.4493, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.69% (1.3693 => 1.4198, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4062 => 0.4188, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.92% (3.9660 => 4.0819, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3626, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.0594 => 1.0892, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5637 => 0.5789, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7038 => 0.7215, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.36% (1.2292 => 1.2582, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2265, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9734, std. dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.11% (13.8202 => 14.1116, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8646 => 3.9401, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.85% (1.1061 => 1.1266, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.82% (0.5818 => 0.5924, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.67% (1.9270 => 1.9591, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4017, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std. dev.: 0.0528) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4102, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7170, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5836, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.70% (7.9275 => 8.1415, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1920, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0307) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6438, std. dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.96% (0.4657 => 0.3681, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.59% (22.5627 => 20.8497, std. dev.: 0.4413) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.16% (0.3940 => 0.3776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.3789 => 0.3632, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.02% (0.9108 => 0.8924, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2100, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5809, std. dev.: 0.0648) MultiSource/Applications/minisat/minisat: -2.46% (9.3358 => 9.1057, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8979, std. dev.: 0.0734) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0950) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1385, std. dev.: 0.0484) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.19% (0.9692 => 0.9577, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 01:30:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 03:30:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612083056.A6B6D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1010?compare_to=1009&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1010, Order: 158353, Start Time: 2012-06-12 07:35:27, End Time: 2012-06-12 08:32:15 To: 1009, Order: 158350, Start Time: 2012-06-12 06:08:43, End Time: 2012-06-12 07:07:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (773 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2717, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.32% (0.4328 => 0.4515, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.16% (1.3693 => 1.4262, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.79% (0.4062 => 0.4216, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.6959 => 0.7200, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.13% (0.3899 => 0.4021, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7038 => 0.7251, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0924, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.2292 => 1.2646, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3580 => 0.3681, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (1.9828 => 2.0384, std. dev.: 0.0120) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2393, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9608, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.2193 => 1.2489, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1510, std. dev.: 0.0397) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4390 => 0.4495, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1627, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 2.25% (0.5818 => 0.5949, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9652, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 1.95% (0.5748 => 0.5860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5392, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 1.78% (0.7061 => 0.7187, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4032, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4030, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7070, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7128, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1508, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1928, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6447, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8849, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3650 => 0.3514, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5783, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0956, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.31% (20.3410 => 19.8717, std. dev.: 0.0626) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9596, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6979, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5119, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2508, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4870, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1956, std. dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 02:08:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 04:08:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612090820.E01D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1011?baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 To: (none) Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 19 (0 on baseline) Added Tests: 861 (0 on baseline) Existing Failures: 0 (19 on baseline) Unchanged Tests: 14 (875 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 03:19:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 05:19:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612101951.9BE882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1012?compare_to=1008&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1012, Order: 158353, Start Time: 2012-06-12 08:05:42, End Time: 2012-06-12 10:21:10 To: 1008, Order: 158349, Start Time: 2012-06-12 04:34:23, End Time: 2012-06-12 06:49:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Unchanged Tests: 894 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 07:43:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 09:43:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612144349.6B6432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1013?compare_to=1010&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1013, Order: 158356, Start Time: 2012-06-12 13:48:42, End Time: 2012-06-12 14:45:08 To: 1010, Order: 158353, Start Time: 2012-06-12 07:35:27, End Time: 2012-06-12 08:32:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (771 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.53% (2.0176 => 2.2704, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.41% (0.4328 => 0.4519, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 4.13% (1.3693 => 1.4258, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4062 => 0.4208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.6959 => 0.7205, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.23% (0.3899 => 0.4025, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0938, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7038 => 0.7251, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2292 => 1.2644, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.83% (2.1791 => 2.2407, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.79% (0.3580 => 0.3680, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 2.78% (16.6129 => 17.0747, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.9828 => 2.0377, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.4016 => 0.4123, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9621, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1503, std. dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.30% (0.4390 => 0.4491, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.1364 => 1.1624, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 2.17% (0.5818 => 0.5944, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5363, std. dev.: 0.0116) SingleSource/UnitTests/ObjC++/Hello: 1.90% (0.5748 => 0.5857, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.7061 => 0.7184, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4035, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (1.3813 => 1.4028, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.15% (0.8698 => 0.8798, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7061, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1875, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 8.28% (1.2998 => 1.4074, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7073, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1209, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5184 => 0.5287, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.29% (1.2308 => 1.2467, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6452, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -24.35% (0.4657 => 0.3523, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.49% (22.5627 => 20.8719, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.74% (0.3663 => 0.3526, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.70% (0.3650 => 0.3515, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.30% (0.8818 => 0.8527, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.6576 => 0.6422, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5898, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1167, std. dev.: 0.0349) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9373, std. dev.: 0.0603) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5130, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.5254 => 2.4872, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2621, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1382, std. dev.: 0.0440) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 07:48:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 09:48:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612144835.0A78A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1014?compare_to=1011&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1014, Order: 158356, Start Time: 2012-06-12 13:48:56, End Time: 2012-06-12 14:49:54 To: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (875 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 09:02:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 11:02:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612160246.6B7842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1015?compare_to=1012&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1015, Order: 158356, Start Time: 2012-06-12 13:48:40, End Time: 2012-06-12 16:04:05 To: 1012, Order: 158353, Start Time: 2012-06-12 08:05:42, End Time: 2012-06-12 10:21:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.53% (0.2122 => 0.2303, std. dev.: 0.0016) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 09:06:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 11:06:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612160632.6C2BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1016?compare_to=1013&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1016, Order: 158358, Start Time: 2012-06-12 15:11:21, End Time: 2012-06-12 16:07:51 To: 1013, Order: 158356, Start Time: 2012-06-12 13:48:42, End Time: 2012-06-12 14:45:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 5 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.26% (17.0747 => 16.8595, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (2.0377 => 2.0127, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.15% (1.4258 => 1.4094, std. dev.: 0.0022) MultiSource/Applications/siod/siod: -1.13% (2.2407 => 2.2153, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -1.06% (1.2644 => 1.2510, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.0176 => 2.2703, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0828, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.93% (1.3693 => 1.4094, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9199 => 0.9457, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.72% (0.6959 => 0.7148, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.3245 => 1.3603, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4062 => 0.4166, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.19% (1.1364 => 1.1613, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (13.2842 => 13.5686, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.97% (13.8202 => 14.0925, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4082, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4075, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 1.81% (0.5748 => 0.5852, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2292 => 1.2510, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7038 => 0.7158, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.66% (2.1791 => 2.2153, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 1.66% (0.7061 => 0.7178, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.51% (3.8646 => 3.9230, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (1.9828 => 2.0127, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.48% (16.6129 => 16.8595, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0206, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4295, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2779, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.18% (0.9996 => 1.0814, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.51% (1.2998 => 1.3974, std. dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7370, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5164, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.90% (11.2619 => 11.5880, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1360, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6409, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8413, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.3789 => 0.3632, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.80% (0.4003 => 0.3851, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.09% (0.9108 => 0.8918, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2044, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (4.9865 => 4.9316, std. dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5969, std. dev.: 0.0139) MultiSource/Benchmarks/Olden/health/health: -2.51% (0.4533 => 0.4419, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.51% (20.3410 => 19.8306, std. dev.: 0.1189) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1054, std. dev.: 0.0442) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9576, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1732, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2517, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 09:16:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 11:16:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612161606.D1F9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1017?compare_to=1014&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1017, Order: 158358, Start Time: 2012-06-12 15:16:26, End Time: 2012-06-12 16:17:26 To: 1014, Order: 158356, Start Time: 2012-06-12 13:48:56, End Time: 2012-06-12 14:49:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 2 (1 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 872 (873 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.55% (10.3671 => 10.6315, std. dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.05% (7.9723 => 8.0562, std. dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.25% (2.0676 => 2.0417, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.55% (10.3673 => 10.6315, std. dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.20% (2.0665 => 2.0417, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 10:29:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 12:29:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612172912.EFB462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1018?compare_to=1016&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1018, Order: 158359, Start Time: 2012-06-12 16:34:02, End Time: 2012-06-12 17:30:32 To: 1016, Order: 158358, Start Time: 2012-06-12 15:11:21, End Time: 2012-06-12 16:07:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.23% (7.9576 => 8.0554, std. dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2690, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4328 => 0.4459, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 2.97% (1.3693 => 1.4100, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9199 => 0.9462, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.85% (3.9660 => 4.0791, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (1.3245 => 1.3587, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4062 => 0.4165, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2473, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5623, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 2.05% (0.5818 => 0.5937, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.02% (13.8202 => 14.0996, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.4563 => 1.4857, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (1.3813 => 1.4084, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (1.3819 => 1.4085, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 1.84% (0.5748 => 0.5854, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2292 => 1.2506, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2156, std. dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: 1.60% (0.7061 => 0.7174, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (3.8646 => 3.9246, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.46% (16.6129 => 16.8549, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (1.9828 => 2.0106, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9519, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.06% (14.8535 => 15.0110, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.17% (1.8175 => 2.2932, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.19% (0.9996 => 1.0815, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4050, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7391, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9771, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5835, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1257, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6447, std. dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9290 => 1.9486, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.28% (0.4657 => 0.3573, std. dev.: 0.0232) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8699, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.37% (0.3940 => 0.3768, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.3789 => 0.3632, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.07% (0.4003 => 0.3840, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.09% (0.9108 => 0.8918, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2072, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.09% (4.9865 => 4.9322, std. dev.: 0.0165) MultiSource/Applications/lua/lua: -1.05% (3.7467 => 3.7075, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5805, std. dev.: 0.0177) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1079, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.28% (20.3410 => 19.8764, std. dev.: 0.1172) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9594, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1891, std. dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 10:43:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 12:43:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612174327.4596D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1019?compare_to=1017&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1019, Order: 158359, Start Time: 2012-06-12 16:43:47, End Time: 2012-06-12 17:44:47 To: 1017, Order: 158358, Start Time: 2012-06-12 15:16:26, End Time: 2012-06-12 16:17:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (873 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.59% (10.3673 => 10.6361, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (2.0665 => 2.0419, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 11:44:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 13:44:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612184421.1303B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1020?compare_to=1015&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1020, Order: 158359, Start Time: 2012-06-12 16:30:16, End Time: 2012-06-12 18:45:40 To: 1015, Order: 158356, Start Time: 2012-06-12 13:48:40, End Time: 2012-06-12 16:04:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 1 (0 on baseline) Unchanged Tests: 892 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.2282 => 0.2390, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -6.73% (0.2303 => 0.2148, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3792 => 0.3895, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.00% (23.5202 => 23.7565, std. dev.: 0.0149) Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 11:52:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 13:52:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612185204.365C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1021?compare_to=1018&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1021, Order: 158364, Start Time: 2012-06-12 17:56:42, End Time: 2012-06-12 18:53:23 To: 1018, Order: 158359, Start Time: 2012-06-12 16:34:02, End Time: 2012-06-12 17:30:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.01% (1.4050 => 1.4192, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2713, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (0.4328 => 0.4463, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.98% (3.9660 => 4.0843, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 2.93% (1.3693 => 1.4094, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9199 => 0.9456, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.63% (1.3245 => 1.3593, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4062 => 0.4166, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2193 => 1.2467, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.22% (0.5818 => 0.5947, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.19% (1.1364 => 1.1613, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (13.2842 => 13.5716, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (1.3819 => 1.4098, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.98% (13.8202 => 14.0941, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.91% (1.3813 => 1.4077, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 1.81% (0.5748 => 0.5852, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.75% (1.2292 => 1.2507, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.4563 => 1.4816, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.70% (2.1791 => 2.2162, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 1.67% (0.7061 => 0.7179, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9288, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.9828 => 2.0126, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.49% (16.6129 => 16.8598, std. dev.: 0.0175) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0138, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4285, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.69% (1.8175 => 2.2845, std. dev.: 0.0310) SingleSource/Benchmarks/Misc/mandel-2: 9.19% (1.2998 => 1.4192, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.08% (0.9996 => 1.0804, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7330, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5151, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1318, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6451, std. dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8568, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.34% (0.3940 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.3789 => 0.3631, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.05% (0.4003 => 0.3841, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2048, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (4.9865 => 4.9297, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0220) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5723, std. dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (20.3410 => 19.8545, std. dev.: 0.0668) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1184, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6993, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1511, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.15% (0.9692 => 0.9581, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 12:10:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 14:10:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612191054.F04C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1022?compare_to=1019&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1022, Order: 158364, Start Time: 2012-06-12 18:11:11, End Time: 2012-06-12 19:12:14 To: 1019, Order: 158359, Start Time: 2012-06-12 16:43:47, End Time: 2012-06-12 17:44:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (873 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.55% (10.3673 => 10.6316, std. dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.13% (2.0665 => 2.0431, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 13:14:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 15:14:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612201457.36AF52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1023?compare_to=1021&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1023, Order: 158365, Start Time: 2012-06-12 19:19:46, End Time: 2012-06-12 20:16:15 To: 1021, Order: 158364, Start Time: 2012-06-12 17:56:42, End Time: 2012-06-12 18:53:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.84% (0.3833 => 0.3609, std. dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2711, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4328 => 0.4460, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.95% (1.3693 => 1.4097, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (3.9660 => 4.0799, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.0594 => 1.0885, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4062 => 0.4166, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.51% (1.3245 => 1.3578, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2463, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8310 => 0.8492, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.18% (0.5818 => 0.5945, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (13.2842 => 13.5670, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.99% (13.8202 => 14.0959, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.94% (1.3819 => 1.4087, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.92% (1.3813 => 1.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.91% (0.7061 => 0.7196, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.79% (1.2292 => 1.2512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 1.77% (0.5748 => 0.5850, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.73% (2.1791 => 2.2167, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.56% (3.8646 => 3.9249, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.54% (1.9828 => 2.0133, std. dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8487, std. dev.: 0.0173) MultiSource/Applications/Burg/burg: 1.39% (1.1061 => 1.1215, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0082, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2696, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.00% (1.2998 => 1.3908, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7297, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1463, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 1.32% (1.2308 => 1.2470, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6444, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.50% (0.4657 => 0.3609, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.5627 => 20.8648, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.34% (0.3940 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: -4.05% (0.4003 => 0.3841, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.13% (0.9108 => 0.8914, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (6.2785 => 6.2040, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (4.9865 => 4.9297, std. dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5963, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1199, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8862, std. dev.: 0.0445) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6988, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1851, std. dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 13:38:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 15:38:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612203838.A10E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1024?compare_to=1022&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1024, Order: 158367, Start Time: 2012-06-12 19:38:49, End Time: 2012-06-12 20:39:58 To: 1022, Order: 158364, Start Time: 2012-06-12 18:11:11, End Time: 2012-06-12 19:12:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Improvements: 1 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (874 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (10.6316 => 10.4475, std. dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.38% (0.7326 => 0.7225, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 14:26:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 16:26:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120612212617.752DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1025?compare_to=1020&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1025, Order: 158365, Start Time: 2012-06-12 19:12:02, End Time: 2012-06-12 21:27:36 To: 1020, Order: 158359, Start Time: 2012-06-12 16:30:16, End Time: 2012-06-12 18:45:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Unchanged Tests: 893 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.75% (0.2148 => 0.2250, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.01% (23.5202 => 23.7574, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.2122 => 0.2250, std. dev.: 0.0017) Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 14:37:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 16:37:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612213745.DC2CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1026?compare_to=1023&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1026, Order: 158368, Start Time: 2012-06-12 20:42:29, End Time: 2012-06-12 21:39:04 To: 1023, Order: 158365, Start Time: 2012-06-12 19:19:46, End Time: 2012-06-12 20:16:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2775, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.65% (0.4328 => 0.4486, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 3.33% (1.3693 => 1.4149, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0951, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9199 => 0.9486, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4062 => 0.4187, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.3245 => 1.3624, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5637 => 0.5789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.49% (0.5818 => 0.5963, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.42% (1.2292 => 1.2589, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6022, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.7710 => 0.7893, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (1.3819 => 1.4145, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 2.35% (0.5748 => 0.5883, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4137, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1298, std. dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.7038 => 0.7195, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2275, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.9828 => 2.0261, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9726, std. dev.: 0.0159) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9448, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 2.04% (0.7061 => 0.7205, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.88% (1.1061 => 1.1269, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0450, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7115, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4310, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std. dev.: 0.0428) SingleSource/Benchmarks/Misc/mandel-2: 8.68% (1.2998 => 1.4126, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.20% (2.0200 => 2.1857, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7349, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.83% (7.9275 => 8.1520, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2455, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6441, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.41% (0.4657 => 0.3660, std. dev.: 0.0141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.43% (22.5627 => 20.8856, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3650 => 0.3494, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.6576 => 0.6422, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0119) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5867, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.29% (9.3358 => 9.1221, std. dev.: 0.0410) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4970, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9617, std. dev.: 0.0463) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6997, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1620, std. dev.: 0.0281) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 15:05:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 17:05:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120612220556.9E7042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1027?compare_to=1024&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1027, Order: 158373, Start Time: 2012-06-12 21:06:14, End Time: 2012-06-12 22:07:13 To: 1024, Order: 158367, Start Time: 2012-06-12 19:38:49, End Time: 2012-06-12 20:39:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.31% (10.4475 => 10.5847, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (10.3673 => 10.5847, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (10.4361 => 10.5584, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.04% (6.6874 => 6.7571, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3045 => 1.3185, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 16:00:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 18:00:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120612230031.24B0C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1028?compare_to=1026&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1028, Order: 158373, Start Time: 2012-06-12 22:05:19, End Time: 2012-06-12 23:01:50 To: 1026, Order: 158368, Start Time: 2012-06-12 20:42:29, End Time: 2012-06-12 21:39:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2740, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.54% (0.4328 => 0.4481, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9199 => 0.9486, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.11% (1.3693 => 1.4119, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.11% (3.9660 => 4.0892, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3638, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4062 => 0.4173, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2328, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.7710 => 0.7888, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.29% (1.3813 => 1.4129, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.23% (13.8202 => 14.1285, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9732, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 2.16% (0.5748 => 0.5872, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.2842 => 13.5662, std. dev.: 0.0211) MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (3.8646 => 3.9446, std. dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2292 => 1.2541, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 1.98% (0.7061 => 0.7201, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.97% (1.1061 => 1.1279, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (1.9828 => 2.0199, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4823, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0097, std. dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0531) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3988, std. dev.: 0.0113) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7376, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1357, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.5184 => 0.5292, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1922, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5116, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.41% (1.9433 => 1.9707, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6450, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.33% (0.4657 => 0.3617, std. dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8754, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.88% (0.3650 => 0.3472, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3601 => 0.3426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3646 => 0.3472, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3663 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.3914 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.12% (0.4003 => 0.3838, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.30% (0.6576 => 0.6359, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.97% (0.9108 => 0.8929, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0107) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5907, std. dev.: 0.0123) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1010, std. dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.48% (20.3410 => 19.8370, std. dev.: 0.0738) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9588, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6990, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2567, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1728, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 17:07:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 19:07:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613000743.2AA6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1029?compare_to=1025&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1029, Order: 158373, Start Time: 2012-06-12 21:53:41, End Time: 2012-06-13 00:09:03 To: 1025, Order: 158365, Start Time: 2012-06-12 19:12:02, End Time: 2012-06-12 21:27:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Performance Improvements: 2 (0 on baseline) Unchanged Tests: 891 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.8171 => 2.8464, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.10% (0.3863 => 0.3666, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.14% (17.3307 => 17.1323, std. dev.: 0.0763) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.53% (2.8036 => 2.8464, std. dev.: 0.0048) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 18:44:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 20:44:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613014407.825DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1030?compare_to=1028&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1030, Order: 158376, Start Time: 2012-06-13 00:48:45, End Time: 2012-06-13 01:45:25 To: 1028, Order: 158373, Start Time: 2012-06-12 22:05:19, End Time: 2012-06-12 23:01:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (70 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.02% (7.9661 => 8.0474, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2695, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.63% (0.4328 => 0.4485, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.6959 => 0.7179, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9199 => 0.9489, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.11% (3.9660 => 4.0893, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.08% (1.3693 => 1.4115, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 2.99% (0.5818 => 0.5992, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3635, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4062 => 0.4171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.68% (0.5748 => 0.5902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (0.7710 => 0.7901, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.44% (0.7038 => 0.7210, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 2.41% (0.7061 => 0.7231, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1511, std. dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 2.33% (16.6129 => 16.9996, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.3819 => 1.4139, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5763, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9489, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4112, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2292 => 1.2550, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9617, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (1.9828 => 2.0180, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7120, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0236, std. dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2890, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2794, std. dev.: 0.0414) SingleSource/Benchmarks/Misc/mandel-2: 8.70% (1.2998 => 1.4129, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7306, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.78% (12.4560 => 12.9270, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1432, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 1.32% (1.2308 => 1.2470, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6448, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std. dev.: 0.0217) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9226, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3663 => 0.3510, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (0.9108 => 0.8951, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6059, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1076, std. dev.: 0.0177) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9210, std. dev.: 0.0339) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6985, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.58% (3.9173 => 3.8555, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1572, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2548, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 18:48:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 20:48:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613014835.00B8D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1031?compare_to=1027&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1031, Order: 158376, Start Time: 2012-06-13 00:48:56, End Time: 2012-06-13 01:49:54 To: 1027, Order: 158373, Start Time: 2012-06-12 21:06:14, End Time: 2012-06-12 22:07:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 2 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (10.5847 => 10.4566, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.07% (5.3959 => 5.3383, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.22% (10.4361 => 10.5636, std. dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.53% (2.0665 => 2.0349, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -1.04% (1.2842 => 1.2708, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 20:02:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 22:02:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613030238.5117B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1032?compare_to=1029&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1032, Order: 158376, Start Time: 2012-06-13 00:48:40, End Time: 2012-06-13 03:03:58 To: 1029, Order: 158373, Start Time: 2012-06-12 21:53:41, End Time: 2012-06-13 00:09:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (0 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 892 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (17.1323 => 17.3315, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.32% (2.8464 => 2.8087, std. dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.34% (2.0820 => 2.0541, std. dev.: 0.0057) Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 20:06:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 22:06:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613030655.06C7B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1033?compare_to=1030&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1033, Order: 158377, Start Time: 2012-06-13 02:11:40, End Time: 2012-06-13 03:08:13 To: 1030, Order: 158376, Start Time: 2012-06-13 00:48:45, End Time: 2012-06-13 01:45:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.44% (3.7610 => 3.8150, std. dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.78% (2.0176 => 2.2755, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (0.4328 => 0.4480, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6959 => 0.7192, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0938, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9199 => 0.9494, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.18% (1.3693 => 1.4129, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0594 => 1.0921, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4062 => 0.4173, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.57% (2.1791 => 2.2351, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7038 => 0.7217, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 2.53% (0.5818 => 0.5965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0161, std. dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1555, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.7710 => 0.7888, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 2.30% (0.5748 => 0.5880, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.25% (1.3813 => 1.4124, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5799, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 2.21% (1.2292 => 1.2564, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9496, std. dev.: 0.0088) MultiSource/Applications/Burg/burg: 2.05% (1.1061 => 1.1288, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.01% (0.7061 => 0.7203, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9645, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (1.9828 => 2.0210, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7174, std. dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0456, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.24% (0.1824 => 0.3543, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2656, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.48% (1.2998 => 1.3970, std. dev.: 0.0148) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7331, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9221, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1511, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.34% (9.0760 => 9.1975, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2308 => 1.2462, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9511, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6452, std. dev.: 0.0110) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7731 => 3.8150, std. dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.85% (0.4657 => 0.3686, std. dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.37% (22.5627 => 20.8994, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.14% (0.3601 => 0.3452, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.3789 => 0.3651, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.32% (1.3780 => 1.3185, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5867, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1104, std. dev.: 0.0205) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9579, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9585, std. dev.: 0.0665) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6989, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5117, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1548, std. dev.: 0.0482) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2534, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 20:15:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 22:15:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613031549.77C6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1034?compare_to=1031&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1034, Order: 158377, Start Time: 2012-06-13 02:16:16, End Time: 2012-06-13 03:17:09 To: 1031, Order: 158376, Start Time: 2012-06-13 00:48:56, End Time: 2012-06-13 01:49:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.24% (10.4361 => 10.5657, std. dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 1.12% (10.3673 => 10.4832, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.23% (3.7781 => 3.8625, std. dev.: 0.0290) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.33% (2.0665 => 2.0390, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 21:29:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 23:29:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613042943.A0A212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1035?compare_to=1033&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1035, Order: 158382, Start Time: 2012-06-13 03:34:31, End Time: 2012-06-13 04:31:02 To: 1033, Order: 158377, Start Time: 2012-06-13 02:11:40, End Time: 2012-06-13 03:08:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2713, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (0.4328 => 0.4480, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9199 => 0.9502, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0959, std. dev.: 0.0090) MultiSource/Applications/hbd/hbd: 3.19% (1.3693 => 1.4130, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.00% (0.4062 => 0.4184, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 2.99% (0.5818 => 0.5992, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.92% (0.5748 => 0.5916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.7038 => 0.7239, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2374, std. dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 2.65% (16.6129 => 17.0535, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.52% (0.7061 => 0.7239, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.7710 => 0.7904, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.47% (3.8646 => 3.9600, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.1364 => 1.1640, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1516, std. dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2292 => 1.2580, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.9828 => 2.0247, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.2842 => 13.5649, std. dev.: 0.0153) MultiSource/Applications/treecc/treecc: 2.09% (1.9270 => 1.9673, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.4563 => 1.4857, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4081, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.34% (3.6692 => 3.7183, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0315, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2886, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2714, std. dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.29% (1.2998 => 1.3946, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7285, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5188, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1433, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6440, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.06% (1.9290 => 1.9495, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.82% (0.4657 => 0.3641, std. dev.: 0.0167) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.46% (22.5627 => 20.8784, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.35% (0.3940 => 0.3808, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.00% (0.6576 => 0.6379, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -3.50% (1.9762 => 1.9070, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6037, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.34% (20.3410 => 19.8643, std. dev.: 0.0755) MultiSource/Applications/minisat/minisat: -2.22% (9.3358 => 9.1282, std. dev.: 0.0264) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1454, std. dev.: 0.0351) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 21:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 12 Jun 2012 23:43:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613044306.A0BFA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1036?compare_to=1034&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1036, Order: 158382, Start Time: 2012-06-13 03:43:30, End Time: 2012-06-13 04:44:26 To: 1034, Order: 158377, Start Time: 2012-06-13 02:16:16, End Time: 2012-06-13 03:17:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 16.60% (0.3620 => 0.4221, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (10.4832 => 10.2839, std. dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 10.58% (0.3817 => 0.4221, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.3045 => 1.3202, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.14% (2.0665 => 2.0429, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: -1.06% (1.5603 => 1.5438, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 22:43:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 00:43:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613054358.4CAA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1037?compare_to=1032&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1037, Order: 158382, Start Time: 2012-06-13 03:30:06, End Time: 2012-06-13 05:45:18 To: 1032, Order: 158376, Start Time: 2012-06-13 00:48:40, End Time: 2012-06-13 03:03:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (1 on baseline) Performance Improvements: 2 (2 on baseline) Unchanged Tests: 890 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.40% (2.8087 => 2.8480, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (2.0541 => 2.0750, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.72% (2.5048 => 2.4616, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -1.01% (2.0334 => 2.0129, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.58% (2.8036 => 2.8480, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.07% (2.0346 => 2.0129, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.00% (1.4269 => 1.4126, std. dev.: 0.0021) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 22:52:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 00:52:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613055228.6E7AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1038?compare_to=1035&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1038, Order: 158386, Start Time: 2012-06-13 04:57:15, End Time: 2012-06-13 05:53:47 To: 1035, Order: 158382, Start Time: 2012-06-13 03:34:31, End Time: 2012-06-13 04:31:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2706, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.54% (0.4328 => 0.4481, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9199 => 0.9502, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.29% (3.9660 => 4.0963, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.24% (1.3693 => 1.4136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.96% (0.5818 => 0.5990, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.7038 => 0.7242, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.82% (0.5748 => 0.5910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.81% (0.4062 => 0.4176, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0453, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 2.58% (0.7061 => 0.7243, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.41% (13.8202 => 14.1528, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (3.8646 => 3.9561, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2480, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.30% (1.2292 => 1.2575, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (13.2842 => 13.5679, std. dev.: 0.0299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.03% (1.9270 => 1.9662, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (1.9828 => 2.0231, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0387, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6692 => 3.7127, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1333 => 1.1461, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4267, std. dev.: 0.0241) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1872, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 8.15% (1.2998 => 1.4057, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7207, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5847, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1421, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9579, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.22% (1.2308 => 1.2458, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6441, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.02% (0.4657 => 0.3678, std. dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.39% (22.5627 => 20.8956, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3042, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5919, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1143, std. dev.: 0.0296) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9567, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.22% (20.3410 => 19.8898, std. dev.: 0.0303) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2512, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0056) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1676, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 12 23:10:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 01:10:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613061024.587752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1039?compare_to=1036&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1039, Order: 158386, Start Time: 2012-06-13 05:10:42, End Time: 2012-06-13 06:11:43 To: 1036, Order: 158382, Start Time: 2012-06-13 03:43:30, End Time: 2012-06-13 04:44:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.21% (3.7732 => 3.8564, std. dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.88% (0.4221 => 0.3635, std. dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.10% (10.4361 => 10.5504, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.07% (3.7781 => 3.8564, std. dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (2.0665 => 2.0415, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: -1.02% (1.5603 => 1.5444, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 00:17:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 02:17:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613071743.478D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1040?compare_to=1038&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1040, Order: 158392, Start Time: 2012-06-13 06:20:02, End Time: 2012-06-13 07:19:02 To: 1038, Order: 158386, Start Time: 2012-06-13 04:57:15, End Time: 2012-06-13 05:53:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (788 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2699, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4328 => 0.4498, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 3.49% (1.3693 => 1.4171, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.17% (1.3245 => 1.3665, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (3.9660 => 4.0916, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9199 => 0.9489, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0331, std. dev.: 0.0087) SingleSource/UnitTests/ObjC++/property-reference-object: 2.53% (0.5818 => 0.5965, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7038 => 0.7215, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2292 => 1.2601, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.2193 => 1.2482, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.9828 => 2.0275, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5805, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9482, std. dev.: 0.0147) SingleSource/UnitTests/ObjC++/Hello: 2.09% (0.5748 => 0.5868, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.84% (0.7061 => 0.7191, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.4563 => 1.4828, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4500, std. dev.: 0.0348) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/fbench: 25.62% (1.8175 => 2.2831, std. dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1896, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3923, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7192, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0653) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.90% (7.9275 => 8.1571, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0138) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0289) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1930, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0215) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5928 => 4.6466, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.29% (0.4657 => 0.3945, std. dev.: 0.0250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9281, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.09% (0.3623 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.74% (0.3663 => 0.3526, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.08% (0.9108 => 0.8919, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std. dev.: 0.0193) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1082, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9607, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9133, std. dev.: 0.0259) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6985, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2558, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1808, std. dev.: 0.0398) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 00:40:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 02:40:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613074007.E8ECB2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1041?compare_to=1039&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1041, Order: 158393, Start Time: 2012-06-13 06:38:09, End Time: 2012-06-13 07:41:27 To: 1039, Order: 158386, Start Time: 2012-06-13 05:10:42, End Time: 2012-06-13 06:11:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.14% (10.4361 => 10.5555, std. dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.25% (3.7781 => 3.8632, std. dev.: 0.0177) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (2.0665 => 2.0420, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 01:27:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 03:27:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613082756.B6E1D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1042?compare_to=1037&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1042, Order: 158390, Start Time: 2012-06-13 06:11:26, End Time: 2012-06-13 08:29:15 To: 1037, Order: 158382, Start Time: 2012-06-13 03:30:06, End Time: 2012-06-13 05:45:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (0 on baseline) Unchanged Tests: 891 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.09% (5.4885 => 5.5485, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.07% (1.5905 => 1.6075, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (4.6486 => 4.6980, std. dev.: 0.0145) ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 01:41:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 03:41:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613084156.D57E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1043?compare_to=1040&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1043, Order: 158395, Start Time: 2012-06-13 07:46:29, End Time: 2012-06-13 08:43:16 To: 1040, Order: 158392, Start Time: 2012-06-13 06:20:02, End Time: 2012-06-13 07:19:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.45% (3.7548 => 3.8468, std. dev.: 0.0223) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.96% (2.0176 => 2.2589, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.74% (0.4328 => 0.4490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.32% (0.5818 => 0.6011, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.26% (1.3693 => 1.4140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9199 => 0.9492, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.6959 => 0.7179, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4062 => 0.4190, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0896, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 3.10% (0.5748 => 0.5926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3245 => 1.3644, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.86% (0.7061 => 0.7263, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.69% (0.3899 => 0.4004, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.54% (0.7710 => 0.7906, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.7038 => 0.7214, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2327, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.42% (1.2292 => 1.2590, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.9828 => 2.0304, std. dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0062, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2193 => 1.2481, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.27% (13.8202 => 14.1333, std. dev.: 0.0192) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9476, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4113, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5556, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 2.00% (1.1061 => 1.1282, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0179, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.15% (1.8175 => 2.2746, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3958, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7270, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8321, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5837, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1383, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 1.95% (3.7731 => 3.8468, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.5928 => 4.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8674, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.26% (0.3646 => 0.3527, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.19% (0.3578 => 0.3464, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: -2.92% (0.3940 => 0.3825, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.90% (0.9108 => 0.8935, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6043, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1174, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.33% (20.3410 => 19.8672, std. dev.: 0.0903) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6996, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4844, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2556, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1739, std. dev.: 0.0175) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.15% (0.9692 => 0.9581, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 02:07:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 04:07:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613090733.EFE8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1044?compare_to=1041&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1044, Order: 158396, Start Time: 2012-06-13 08:08:02, End Time: 2012-06-13 09:08:53 To: 1041, Order: 158393, Start Time: 2012-06-13 06:38:09, End Time: 2012-06-13 07:41:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.58% (10.3602 => 10.7315, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 27.84% (6.9097 => 8.8334, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.51% (10.3673 => 10.7315, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (10.4361 => 10.5875, std. dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.07% (1.2842 => 1.2704, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.03% (1.5603 => 1.5442, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 03:04:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 05:04:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613100453.791942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1045?compare_to=1043&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1045, Order: 158396, Start Time: 2012-06-13 09:09:37, End Time: 2012-06-13 10:06:13 To: 1043, Order: 158395, Start Time: 2012-06-13 07:46:29, End Time: 2012-06-13 08:43:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.12% (2.0176 => 2.2622, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.37% (0.4328 => 0.4474, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.08% (0.6959 => 0.7173, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0140) MultiSource/Applications/hbd/hbd: 2.94% (1.3693 => 1.4095, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4062 => 0.4173, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.61% (1.3245 => 1.3591, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.5818 => 0.5953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2272, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2193 => 1.2459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.17% (0.5748 => 0.5873, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.11% (16.6129 => 16.9635, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 2.08% (1.2292 => 1.2548, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (1.3819 => 1.4104, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.04% (13.8202 => 14.1028, std. dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (1.9828 => 2.0224, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.98% (0.7061 => 0.7201, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.97% (1.3813 => 1.4085, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.96% (3.8646 => 3.9404, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5422, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.86% (1.1061 => 1.1267, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.4563 => 1.4814, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9565, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0407) SingleSource/Benchmarks/Misc/mandel-2: 8.63% (1.2998 => 1.4120, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7193, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (2.8606 => 2.9623, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5185, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1441, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9518, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6463, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.00% (0.4657 => 0.3586, std. dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.70% (22.5627 => 20.8246, std. dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.44% (0.3511 => 0.3320, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.70% (0.3646 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.63% (0.3663 => 0.3530, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.95% (0.9108 => 0.8930, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.60% (0.6576 => 0.6471, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (4.9865 => 4.9308, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5901, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: -2.51% (0.4533 => 0.4419, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1166, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6994, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5139, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9796, std. dev.: 0.0554) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2600, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1461, std. dev.: 0.0383) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 04:09:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 06:09:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613110938.260812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1046?compare_to=1042&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1046, Order: 158396, Start Time: 2012-06-13 08:55:39, End Time: 2012-06-13 11:10:58 To: 1042, Order: 158390, Start Time: 2012-06-13 06:11:26, End Time: 2012-06-13 08:29:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Unchanged Tests: 893 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.92% (2.0615 => 2.1011, std. dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.07% (2.0673 => 2.0895, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.66% (2.8036 => 2.8501, std. dev.: 0.0023) Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 04:15:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 06:15:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613111532.063062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1047?compare_to=1044&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1047, Order: 158398, Start Time: 2012-06-13 10:16:02, End Time: 2012-06-13 11:16:52 To: 1044, Order: 158396, Start Time: 2012-06-13 08:08:02, End Time: 2012-06-13 09:08:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Improvements: 1 (4 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (10.7315 => 10.4515, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.80% (2.0665 => 2.0294, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -1.65% (0.7326 => 0.7205, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -1.45% (1.2842 => 1.2656, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: -1.24% (1.5603 => 1.5410, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 04:27:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 06:27:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613112746.8D4E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1048?compare_to=1045&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1048, Order: 158398, Start Time: 2012-06-13 10:32:30, End Time: 2012-06-13 11:29:06 To: 1045, Order: 158396, Start Time: 2012-06-13 09:09:37, End Time: 2012-06-13 10:06:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (49 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.06% (3.8129 => 3.8916, std. dev.: 0.0175) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2710, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4328 => 0.4472, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.94% (1.3693 => 1.4096, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.71% (0.4062 => 0.4172, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (3.9660 => 4.0705, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.0594 => 1.0871, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.6959 => 0.7132, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.3819 => 1.4152, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.3245 => 1.3562, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.5818 => 0.5953, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.7710 => 0.7882, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.20% (1.3813 => 1.4117, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 2.17% (0.5748 => 0.5873, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.05% (1.2193 => 1.2443, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 1.91% (0.7061 => 0.7196, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.90% (13.8202 => 14.0831, std. dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (1.9828 => 2.0198, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.2842 => 13.5258, std. dev.: 0.0161) MultiSource/Applications/siod/siod: 1.60% (2.1791 => 2.2139, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4791, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.46% (16.6129 => 16.8559, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 1.38% (3.8646 => 3.9180, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 1.37% (1.1061 => 1.1212, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.22% (1.9270 => 1.9506, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 26.68% (1.8175 => 2.3024, std. dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9996 => 1.0813, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3927, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7289, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 3.14% (3.7731 => 3.8916, std. dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.02% (7.9275 => 8.1668, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.27% (1.2308 => 1.2464, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9528, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6441, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.85% (0.4657 => 0.3686, std. dev.: 0.0344) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.89% (22.5627 => 20.7817, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3623 => 0.3493, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3646 => 0.3521, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.39% (0.3663 => 0.3539, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.25% (0.3789 => 0.3666, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.3914 => 0.3791, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.44% (0.9108 => 0.8886, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.31% (4.9865 => 4.9211, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.2785 => 6.1969, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7002, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3024, std. dev.: 0.0121) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1187, std. dev.: 0.0246) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9258, std. dev.: 0.0337) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1829, std. dev.: 0.0400) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 06:44:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 08:44:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613134452.9C1AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1049?compare_to=1048&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1049, Order: 158399, Start Time: 2012-06-13 12:49:32, End Time: 2012-06-13 13:46:12 To: 1048, Order: 158398, Start Time: 2012-06-13 10:32:30, End Time: 2012-06-13 11:29:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.00% (3.8916 => 3.8139, std. dev.: 0.0272) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2759, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4328 => 0.4489, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.01% (1.3693 => 1.4105, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0836, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 2.88% (0.4062 => 0.4179, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (1.3245 => 1.3595, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.61% (0.5818 => 0.5970, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.38% (0.5748 => 0.5885, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.3819 => 1.4140, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.24% (0.7061 => 0.7219, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.7710 => 0.7882, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.23% (1.3813 => 1.4121, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.9828 => 2.0244, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0976, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2292 => 1.2538, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2221, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5303, std. dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.4563 => 1.4828, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 1.75% (16.6129 => 16.9041, std. dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (3.8646 => 3.9279, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.50% (1.9270 => 1.9560, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.01% (1.8175 => 2.2902, std. dev.: 0.0342) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7190, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (2.8606 => 2.9648, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5170, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.77% (7.9275 => 8.1473, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6420, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std. dev.: 0.0191) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.75% (22.5627 => 20.8147, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.34% (0.3623 => 0.3502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.30% (0.3601 => 0.3482, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.29% (0.3650 => 0.3530, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -3.22% (0.3940 => 0.3813, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.14% (0.3663 => 0.3548, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.10% (0.3578 => 0.3467, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: -2.98% (0.3789 => 0.3676, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.28% (0.9108 => 0.8900, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (6.2785 => 6.2039, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.10% (3.7467 => 3.7055, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (4.9865 => 4.9364, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1132, std. dev.: 0.0295) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5002, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7020, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9739, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.46% (6.3560 => 6.2629, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1705, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 06:50:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 08:50:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613135059.AF8252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1050?compare_to=1046&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1050, Order: 158398, Start Time: 2012-06-13 11:37:11, End Time: 2012-06-13 13:52:20 To: 1046, Order: 158396, Start Time: 2012-06-13 08:55:39, End Time: 2012-06-13 11:10:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 893 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.69% (0.2267 => 0.2396, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.51% (2.8036 => 2.8459, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.36% (0.3792 => 0.3475, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7171 => 0.7068, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.00% (2.1013 => 2.0802, std. dev.: 0.0022) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 06:51:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 08:51:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613135151.EAAB32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1051?compare_to=1047&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1051, Order: 158399, Start Time: 2012-06-13 12:52:06, End Time: 2012-06-13 13:53:12 To: 1047, Order: 158398, Start Time: 2012-06-13 10:16:02, End Time: 2012-06-13 11:16:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (3 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.35% (10.4515 => 10.5926, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (10.3673 => 10.5926, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (10.4361 => 10.5431, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.67% (2.0665 => 2.0319, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.62% (0.7326 => 0.7207, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -1.27% (1.2842 => 1.2679, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 08:07:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 10:07:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613150744.5A0632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1052?compare_to=1049&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1052, Order: 158402, Start Time: 2012-06-13 14:12:27, End Time: 2012-06-13 15:09:04 To: 1049, Order: 158399, Start Time: 2012-06-13 12:49:32, End Time: 2012-06-13 13:46:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.77% (2.0176 => 2.2752, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4328 => 0.4489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.93% (0.4062 => 0.4181, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.92% (1.3693 => 1.4093, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (3.9660 => 4.0794, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 2.63% (0.5818 => 0.5971, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.6959 => 0.7142, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.55% (1.3245 => 1.3583, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4158, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 2.40% (0.5748 => 0.5886, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4119, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 2.18% (0.7061 => 0.7215, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.9828 => 2.0248, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.05% (1.2292 => 1.2544, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0978, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1364 => 1.1589, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.80% (2.1791 => 2.2183, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5196, std. dev.: 0.0208) MultiSource/Applications/kimwitu++/kc: 1.65% (16.6129 => 16.8870, std. dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (3.8646 => 3.9270, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.4563 => 1.4796, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.55% (1.1061 => 1.1232, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.7460 => 0.7564, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2673, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/mandel-2: 8.82% (1.2998 => 1.4145, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.07% (0.9996 => 1.0803, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7217, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9178, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1366, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (0.5184 => 0.5309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6431, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.74% (22.5627 => 20.8158, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.34% (0.3623 => 0.3502, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.28% (0.3601 => 0.3483, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: -3.20% (0.3940 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.15% (0.3646 => 0.3531, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.14% (0.3663 => 0.3548, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/parameter-passing: -2.95% (0.4003 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.34% (0.9108 => 0.8895, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.21% (6.2785 => 6.2027, std. dev.: 0.0082) MultiSource/Applications/lua/lua: -1.18% (3.7467 => 3.7025, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0106) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5744, std. dev.: 0.0095) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1147, std. dev.: 0.0388) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9554, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4966, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9298, std. dev.: 0.0384) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7019, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1667, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.20% (0.9692 => 0.9576, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 08:19:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 10:19:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613151905.D9A262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1053?compare_to=1051&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1053, Order: 158402, Start Time: 2012-06-13 14:19:34, End Time: 2012-06-13 15:20:26 To: 1051, Order: 158399, Start Time: 2012-06-13 12:52:06, End Time: 2012-06-13 13:53:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (10.3673 => 10.5889, std. dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.66% (2.0665 => 2.0322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.57% (0.7326 => 0.7211, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -1.35% (1.2842 => 1.2668, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.08% (1.5603 => 1.5435, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 09:32:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 11:32:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613163224.D1A512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1054?compare_to=1050&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1054, Order: 158402, Start Time: 2012-06-13 14:18:32, End Time: 2012-06-13 16:33:43 To: 1050, Order: 158398, Start Time: 2012-06-13 11:37:11, End Time: 2012-06-13 13:52:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.46% (0.3792 => 0.3509, std. dev.: 0.0096) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 10:20:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 12:20:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613172053.2CF872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1055?compare_to=1052&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1055, Order: 158404, Start Time: 2012-06-13 16:25:35, End Time: 2012-06-13 17:22:13 To: 1052, Order: 158402, Start Time: 2012-06-13 14:12:27, End Time: 2012-06-13 15:09:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.31% (2.0176 => 2.2660, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.30% (0.4328 => 0.4471, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.07% (1.3693 => 1.4113, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0838, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.3245 => 1.3611, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 2.76% (0.4062 => 0.4174, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.5818 => 0.5953, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.28% (2.1791 => 2.2288, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4125, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.19% (16.6129 => 16.9761, std. dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 2.18% (13.8202 => 14.1217, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7038 => 0.7188, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2292 => 1.2549, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 2.09% (0.5748 => 0.5868, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (3.8646 => 3.9441, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (1.9828 => 2.0218, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: 1.94% (0.7061 => 0.7198, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (1.3813 => 1.4079, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5300, std. dev.: 0.0163) MultiSource/Applications/Burg/burg: 1.80% (1.1061 => 1.1260, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4800, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 26.11% (1.8175 => 2.2921, std. dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3963, std. dev.: 0.0121) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7236, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9224, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5173, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1566, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6459, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.67% (0.4657 => 0.3834, std. dev.: 0.0198) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.72% (22.5627 => 20.8217, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.16% (0.9108 => 0.8911, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0118) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.8259 => 8.5712, std. dev.: 0.0173) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1234, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6965, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9856, std. dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2549, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.8887 => 3.8437, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2151, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 10:25:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 12:25:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613172548.10C7F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1056?compare_to=1053&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1056, Order: 158404, Start Time: 2012-06-13 16:26:09, End Time: 2012-06-13 17:27:08 To: 1053, Order: 158402, Start Time: 2012-06-13 14:19:34, End Time: 2012-06-13 15:20:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (873 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.28% (10.3673 => 10.6033, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 1.21% (10.4361 => 10.5619, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 11:43:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 13:43:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613184356.0D9452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1057?compare_to=1055&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1057, Order: 158406, Start Time: 2012-06-13 17:48:46, End Time: 2012-06-13 18:45:15 To: 1055, Order: 158404, Start Time: 2012-06-13 16:25:35, End Time: 2012-06-13 17:22:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.58% (1.3963 => 1.4184, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.32% (2.0176 => 2.2662, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.26% (0.4328 => 0.4469, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0856, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.01% (0.9199 => 0.9476, std. dev.: 0.0057) MultiSource/Applications/hbd/hbd: 2.99% (1.3693 => 1.4103, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4062 => 0.4171, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.0594 => 1.0874, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.27% (0.5818 => 0.5950, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2272, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1181, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.12% (16.6129 => 16.9650, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.3819 => 1.4102, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2292 => 1.2543, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 2.04% (0.5748 => 0.5865, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9427, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 1.94% (0.7061 => 0.7198, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (1.9828 => 2.0198, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5298, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.59% (1.4563 => 1.4795, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2665, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/mandel-2: 9.12% (1.2998 => 1.4184, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.26% (2.0200 => 2.1868, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.07% (0.9996 => 1.0803, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7327, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9224, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.88% (7.9275 => 8.1557, std. dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5860, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6452, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.11% (0.4657 => 0.3674, std. dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.77% (22.5627 => 20.8088, std. dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3650 => 0.3508, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.60% (0.3940 => 0.3798, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.20% (0.9108 => 0.8908, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.9865 => 4.9338, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std. dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0258) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1112, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8822, std. dev.: 0.0431) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0185) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1827, std. dev.: 0.0257) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 11:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 13:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613185309.E80842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1058?compare_to=1056&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1058, Order: 158406, Start Time: 2012-06-13 17:53:30, End Time: 2012-06-13 18:54:30 To: 1056, Order: 158404, Start Time: 2012-06-13 16:26:09, End Time: 2012-06-13 17:27:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (3 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.08% (1.2325 => 1.2458, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.24% (10.3673 => 10.6000, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (10.4361 => 10.5575, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7781 => 3.8455, std. dev.: 0.0180) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 12:13:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 14:13:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613191340.95F712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1059?compare_to=1054&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1059, Order: 158404, Start Time: 2012-06-13 16:59:52, End Time: 2012-06-13 19:15:00 To: 1054, Order: 158402, Start Time: 2012-06-13 14:18:32, End Time: 2012-06-13 16:33:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Unchanged Tests: 894 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 13:06:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 15:06:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613200648.1A1562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1060?compare_to=1057&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1060, Order: 158411, Start Time: 2012-06-13 19:11:35, End Time: 2012-06-13 20:08:08 To: 1057, Order: 158406, Start Time: 2012-06-13 17:48:46, End Time: 2012-06-13 18:45:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (64 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.88% (2.2665 => 2.3092, std. dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2689, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.37% (1.3693 => 1.4154, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4328 => 0.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.9199 => 0.9477, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0837, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3626, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4062 => 0.4171, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2315, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.23% (16.6129 => 16.9827, std. dev.: 0.0167) MultiSource/Applications/SPASS/SPASS: 2.17% (13.8202 => 14.1196, std. dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8646 => 3.9430, std. dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference-object: 1.98% (0.5818 => 0.5933, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.97% (1.1061 => 1.1279, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 1.94% (1.2292 => 1.2530, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (1.9828 => 2.0190, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5203, std. dev.: 0.0192) SingleSource/UnitTests/ObjC++/Hello: 1.76% (0.5748 => 0.5849, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.71% (1.9270 => 1.9600, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7061 => 0.7180, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4045, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 27.05% (1.8175 => 2.3092, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1872, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.63% (1.2998 => 1.3860, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7234, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5842, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1451, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.46% (10.7476 => 10.9049, std. dev.: 0.0314) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.19% (4.5928 => 4.6476, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.64% (0.4657 => 0.3696, std. dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.67% (22.5627 => 20.8323, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3578 => 0.3425, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -4.06% (0.3789 => 0.3635, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.72% (0.4003 => 0.3854, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.12% (0.9108 => 0.8915, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2138, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5934, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.30% (9.3358 => 9.1208, std. dev.: 0.0277) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9581, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9183, std. dev.: 0.0491) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7025, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1107, std. dev.: 0.0421) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 13:20:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 15:20:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613202027.B5FC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1061?compare_to=1058&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1061, Order: 158411, Start Time: 2012-06-13 19:21:03, End Time: 2012-06-13 20:21:48 To: 1058, Order: 158406, Start Time: 2012-06-13 17:53:30, End Time: 2012-06-13 18:54:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (10.3673 => 10.5502, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.97% (0.3817 => 0.3589, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -1.57% (0.7326 => 0.7211, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.40% (2.0665 => 2.0375, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -1.15% (1.2842 => 1.2694, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 14:29:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 16:29:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613212940.838432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1062?compare_to=1060&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1062, Order: 158416, Start Time: 2012-06-13 20:34:28, End Time: 2012-06-13 21:31:00 To: 1060, Order: 158411, Start Time: 2012-06-13 19:11:35, End Time: 2012-06-13 20:08:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (69 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.10% (1.3860 => 1.4013, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.79% (2.3092 => 2.2678, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.63% (2.0176 => 2.2724, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4328 => 0.4487, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.34% (1.3693 => 1.4150, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0956, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4062 => 0.4185, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.3245 => 1.3637, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.3899 => 0.4013, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.81% (16.6129 => 17.0803, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2389, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (0.7038 => 0.7231, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.49% (0.5818 => 0.5963, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (3.8646 => 3.9577, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1524, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.40% (0.7710 => 0.7895, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.29% (1.2292 => 1.2574, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 2.14% (0.5748 => 0.5871, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.9828 => 2.0248, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 2.03% (0.7061 => 0.7204, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9660, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5438, std. dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.95% (1.4563 => 1.4847, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (1.3813 => 1.4079, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4075, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7113, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0164, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2678, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.18% (2.0200 => 2.1852, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5165, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.96% (7.9275 => 8.1619, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6446, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.71% (0.4657 => 0.3646, std. dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.5627 => 20.8927, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.3789 => 0.3651, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5971, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1104, std. dev.: 0.0105) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9115, std. dev.: 0.0333) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1570, std. dev.: 0.0341) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8722, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 14:47:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 16:47:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613214741.7898C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1063?compare_to=1061&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1063, Order: 158416, Start Time: 2012-06-13 20:48:09, End Time: 2012-06-13 21:49:01 To: 1061, Order: 158411, Start Time: 2012-06-13 19:21:03, End Time: 2012-06-13 20:21:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.78% (10.3673 => 10.5514, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (5.3526 => 5.4275, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.24% (6.6874 => 6.7705, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 14:55:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 16:55:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120613215509.4FEDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1064?compare_to=1059&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1064, Order: 158413, Start Time: 2012-06-13 19:41:11, End Time: 2012-06-13 21:56:29 To: 1059, Order: 158404, Start Time: 2012-06-13 16:59:52, End Time: 2012-06-13 19:15:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (0 on baseline) Unchanged Tests: 893 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (2.0655 => 2.0930, std. dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 15:52:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 17:52:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120613225227.78DD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1065?compare_to=1062&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1065, Order: 158420, Start Time: 2012-06-13 21:57:12, End Time: 2012-06-13 22:53:47 To: 1062, Order: 158416, Start Time: 2012-06-13 20:34:28, End Time: 2012-06-13 21:31:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3646 => 0.3820, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.49% (2.2678 => 2.3697, std. dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2850, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4328 => 0.4507, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (3.9660 => 4.1124, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.9199 => 0.9538, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 3.66% (0.5818 => 0.6031, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5265 => 0.5456, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4062 => 0.4208, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.55% (1.3693 => 1.4179, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.0594 => 1.0966, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.42% (1.3245 => 1.3698, std. dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5748 => 0.5942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.27% (0.3485 => 0.3599, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.24% (0.7061 => 0.7290, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.05% (0.7710 => 0.7945, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2447, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.98% (0.3899 => 0.4015, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3580 => 0.3685, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.92% (1.2292 => 1.2651, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.2193 => 1.2543, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0831, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.82% (13.2842 => 13.6590, std. dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2087, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7038 => 0.7234, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (1.9828 => 2.0374, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.4563 => 1.4947, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9654, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.4016 => 0.4117, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.41% (1.9270 => 1.9734, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.39% (1.3819 => 1.4149, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4138, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (3.6692 => 3.7273, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.53% (0.7506 => 0.7621, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.49% (14.8535 => 15.0741, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1333 => 1.1492, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7353, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (0.8698 => 0.8810, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4678, std. dev.: 0.0198) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6514, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1225, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 30.38% (1.8175 => 2.3697, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.62% (2.0200 => 2.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.53% (1.2998 => 1.3847, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.75% (7.4271 => 7.7058, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5841, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1398, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6453, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.97% (0.4657 => 0.3820, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.19% (22.5627 => 20.9413, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3034, std. dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5775, std. dev.: 0.0230) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1130, std. dev.: 0.0358) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9230, std. dev.: 0.0204) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6995, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1652, std. dev.: 0.0293) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2492, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.08% (0.9692 => 0.9587, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 16:14:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 18:14:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120613231454.652D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1066?compare_to=1063&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1066, Order: 158420, Start Time: 2012-06-13 22:15:24, End Time: 2012-06-13 23:16:13 To: 1063, Order: 158416, Start Time: 2012-06-13 20:48:09, End Time: 2012-06-13 21:49:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.40% (22.2133 => 21.6800, std. dev.: 0.0227) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (5.3526 => 5.4259, std. dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.24% (22.1758 => 21.6800, std. dev.: 0.0227) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (2.2022 => 2.1776, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 17:15:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 19:15:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614001523.297DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1067?compare_to=1065&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1067, Order: 158424, Start Time: 2012-06-13 23:20:04, End Time: 2012-06-14 00:16:43 To: 1065, Order: 158420, Start Time: 2012-06-13 21:57:12, End Time: 2012-06-13 22:53:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (87 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (767 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -4.45% (2.3697 => 2.2642, std. dev.: 0.0266) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.17% (2.0176 => 2.2833, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.25% (0.4328 => 0.4512, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.82% (1.3693 => 1.4216, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 3.72% (0.4062 => 0.4213, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.6959 => 0.7213, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1085, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0960, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.42% (0.5265 => 0.5445, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3692, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3485 => 0.3601, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.32% (0.5818 => 0.6011, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.13% (0.3899 => 0.4021, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.12% (2.1791 => 2.2471, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 3.06% (0.5748 => 0.5924, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.02% (16.6129 => 17.1142, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.7710 => 0.7942, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2292 => 1.2653, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 2.93% (0.7061 => 0.7268, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.92% (0.3489 => 0.3591, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3580 => 0.3683, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (1.9828 => 2.0398, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.2193 => 1.2543, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7038 => 0.7240, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2005, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (3.8646 => 3.9701, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.4016 => 0.4121, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.54% (1.1061 => 1.1342, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6195, std. dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4390 => 0.4498, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.34% (1.9270 => 1.9720, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4131, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.17% (1.3813 => 1.4113, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.69% (0.7506 => 0.7633, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (3.6692 => 3.7280, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0867, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1491, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4761, std. dev.: 0.0238) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.8698 => 0.8805, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (6.5754 => 6.6558, std. dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6683, std. dev.: 0.0093) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2236, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1007 => 2.1234, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.07% (7.2180 => 7.2949, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9996 => 1.0789, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (1.5824 => 1.7004, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3949, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.80% (7.4271 => 7.7097, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1234, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.87% (1.9433 => 1.9797, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6459, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.07% (0.4657 => 0.3955, std. dev.: 0.0269) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.06% (22.5627 => 20.9694, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5919, std. dev.: 0.0242) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1078, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8945, std. dev.: 0.0429) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5004, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2539, std. dev.: 0.0084) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1212, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8471, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 17:36:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 19:36:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614003637.142102A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1068?compare_to=1064&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1068, Order: 158421, Start Time: 2012-06-13 22:22:40, End Time: 2012-06-14 00:37:56 To: 1064, Order: 158413, Start Time: 2012-06-13 19:41:11, End Time: 2012-06-13 21:56:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (3 on baseline) Unchanged Tests: 892 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 9.90% (0.3769 => 0.4142, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.2280 => 0.2430, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 9.23% (0.3792 => 0.4142, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0673 => 2.0881, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std. dev.: 0.0029) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 17:42:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 19:42:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614004207.57E5A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1069?compare_to=1066&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1069, Order: 158424, Start Time: 2012-06-13 23:42:37, End Time: 2012-06-14 00:43:28 To: 1066, Order: 158420, Start Time: 2012-06-13 22:15:24, End Time: 2012-06-13 23:16:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (10.3673 => 10.5299, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (5.3526 => 5.4343, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (10.4361 => 10.5843, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.95% (22.1758 => 21.7432, std. dev.: 0.0134) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 18:38:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 20:38:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614013817.BEFA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1070?compare_to=1067&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1070, Order: 158426, Start Time: 2012-06-14 00:42:59, End Time: 2012-06-14 01:39:37 To: 1067, Order: 158424, Start Time: 2012-06-13 23:20:04, End Time: 2012-06-14 00:16:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.77% (2.0176 => 2.2752, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.30% (0.4328 => 0.4514, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.86% (1.3693 => 1.4222, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.6959 => 0.7225, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4062 => 0.4212, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.68% (0.5265 => 0.5459, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (3.9660 => 4.1106, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.49% (0.7710 => 0.7979, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.3899 => 0.4035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3485 => 0.3604, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0093) SingleSource/UnitTests/ObjC++/property-reference-object: 3.28% (0.5818 => 0.6009, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.18% (0.5748 => 0.5931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3580 => 0.3693, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 3.03% (0.7061 => 0.7275, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 3.01% (0.7038 => 0.7250, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 2.99% (16.6129 => 17.1091, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.96% (1.2292 => 1.2656, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2436, std. dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (1.9828 => 2.0411, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.2193 => 1.2536, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 2.72% (13.8202 => 14.1955, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9676, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4016 => 0.4122, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1337, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6077, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.3819 => 1.4153, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.39% (1.9270 => 1.9730, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.28% (0.4390 => 0.4490, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0888, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: 1.56% (0.7506 => 0.7623, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (3.6692 => 3.7212, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.28% (16.2614 => 16.4691, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.8698 => 0.8805, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6533, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.15% (2.1007 => 2.1249, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2938, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2217, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std. dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1895, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4027, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7201, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5868, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1409, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6462, std. dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9501, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -2.84% (0.3623 => 0.3520, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.73% (0.6576 => 0.6462, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1157, std. dev.: 0.0187) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8974, std. dev.: 0.0230) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6960, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2536, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1500, std. dev.: 0.0284) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 19:09:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 21:09:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614020931.A37532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1071?compare_to=1069&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1071, Order: 158426, Start Time: 2012-06-14 01:09:51, End Time: 2012-06-14 02:10:52 To: 1069, Order: 158424, Start Time: 2012-06-13 23:42:37, End Time: 2012-06-14 00:43:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.16% (10.3673 => 10.5910, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (5.3526 => 5.4234, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (10.4361 => 10.5603, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.02% (22.1758 => 21.7271, std. dev.: 0.0181) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 20:01:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 22:01:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614030121.64BC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1072?compare_to=1070&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1072, Order: 158437, Start Time: 2012-06-14 02:06:03, End Time: 2012-06-14 03:02:41 To: 1070, Order: 158426, Start Time: 2012-06-14 00:42:59, End Time: 2012-06-14 01:39:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (88 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (762 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.57% (0.4328 => 0.4526, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.06% (0.4062 => 0.4227, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.81% (0.2781 => 0.2887, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2782 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (0.3485 => 0.3613, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.65% (1.3693 => 1.4193, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1055, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.2966 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.47% (0.3022 => 0.3127, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.3899 => 0.4033, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.5818 => 0.6016, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.3245 => 1.3694, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.38% (0.3580 => 0.3701, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.31% (2.1791 => 2.2512, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (1.9828 => 2.0484, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.22% (1.2292 => 1.2688, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3489 => 0.3601, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.20% (0.5748 => 0.5932, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4016 => 0.4144, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.7038 => 0.7255, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.07% (0.3453 => 0.3559, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.03% (0.7061 => 0.7275, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.92% (16.6129 => 17.0985, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.85% (13.8202 => 14.2136, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.73% (1.1364 => 1.1674, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9671, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.4390 => 0.4504, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (13.2842 => 13.6214, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9715, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.7460 => 0.7628, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (1.3819 => 1.4109, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.51% (0.7506 => 0.7619, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0762, std. dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4791, std. dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (0.8698 => 0.8812, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.24% (33.2944 => 33.7061, std. dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6490, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3081, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0514) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.25% (1.2998 => 1.4070, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7177, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.90% (11.2619 => 11.5886, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1446, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6439, std. dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.32% (0.4657 => 0.3804, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9522, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.93% (0.3650 => 0.3543, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.84% (0.3663 => 0.3559, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -2.82% (0.3623 => 0.3521, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -2.61% (0.3940 => 0.3837, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.6576 => 0.6465, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.47% (0.9108 => 0.8974, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5747, std. dev.: 0.0273) MultiSource/Applications/minisat/minisat: -2.53% (9.3358 => 9.0997, std. dev.: 0.0193) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4867 => 0.4760, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9162, std. dev.: 0.0487) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4959, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6979, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1467, std. dev.: 0.0381) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2512, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 20:18:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 22:18:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614031820.8E25B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1073?compare_to=1068&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1073, Order: 158426, Start Time: 2012-06-14 01:04:21, End Time: 2012-06-14 03:19:41 To: 1068, Order: 158421, Start Time: 2012-06-13 22:22:40, End Time: 2012-06-14 00:37:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.07% (2.0673 => 2.0895, std. dev.: 0.0016) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 20:36:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 22:36:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614033647.E0ECF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1074?compare_to=1071&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1074, Order: 158437, Start Time: 2012-06-14 02:37:17, End Time: 2012-06-14 03:38:07 To: 1071, Order: 158426, Start Time: 2012-06-14 01:09:51, End Time: 2012-06-14 02:10:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (3 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (10.5910 => 10.8234, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.37% (5.4134 => 5.3392, std. dev.: 0.0188) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.40% (10.3673 => 10.8234, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (5.3526 => 5.4273, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (10.4361 => 10.5761, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.04% (22.1758 => 21.7228, std. dev.: 0.0163) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.06% (2.2022 => 2.1788, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 21:24:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 13 Jun 2012 23:24:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614042428.3BBD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1075?compare_to=1072&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1075, Order: 158438, Start Time: 2012-06-14 03:28:58, End Time: 2012-06-14 04:25:48 To: 1072, Order: 158437, Start Time: 2012-06-14 02:06:03, End Time: 2012-06-14 03:02:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (757 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.01% (2.0176 => 2.2800, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.51% (0.4328 => 0.4523, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4062 => 0.4222, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 3.78% (0.2781 => 0.2886, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.74% (1.3693 => 1.4205, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2782 => 0.2885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1064, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.53% (0.5265 => 0.5451, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3022 => 0.3128, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 3.49% (0.5818 => 0.6021, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.2937 => 0.3039, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.43% (2.1791 => 2.2538, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3489 => 0.3608, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3899 => 0.4031, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.37% (0.2966 => 0.3066, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (1.9828 => 2.0496, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5748 => 0.5941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3580 => 0.3698, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.28% (1.2292 => 1.2695, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.21% (0.7038 => 0.7264, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4016 => 0.4142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.13% (0.7061 => 0.7282, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 3.08% (16.6129 => 17.1238, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3453 => 0.3557, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.7710 => 0.7940, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2201, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (1.1364 => 1.1686, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2535, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (0.3756 => 0.3860, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4390 => 0.4510, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.72% (3.8646 => 3.9698, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.3868 => 0.3972, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (13.2842 => 13.6341, std. dev.: 0.0283) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1338, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.4563 => 1.4903, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4088, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.52% (0.7506 => 0.7620, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0709, std. dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7198, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.36% (1.1333 => 1.1487, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (0.8698 => 0.8816, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.36% (16.2614 => 16.4819, std. dev.: 0.0189) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7261, std. dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6531, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3088, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.00% (2.1007 => 2.1218, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.08% (0.1824 => 0.3540, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2714, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/mandel-2: 8.51% (1.2998 => 1.4104, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7389, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5173, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1441, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6456, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.43% (0.4657 => 0.3659, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9577, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -2.98% (0.3623 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.83% (0.3601 => 0.3499, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.59% (0.3940 => 0.3838, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6034, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1165, std. dev.: 0.0332) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8969, std. dev.: 0.0604) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1775, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8458, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 22:04:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 00:04:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614050408.E91122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1076?compare_to=1074&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1076, Order: 158440, Start Time: 2012-06-14 04:04:37, End Time: 2012-06-14 05:05:30 To: 1074, Order: 158437, Start Time: 2012-06-14 02:37:17, End Time: 2012-06-14 03:38:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.37% (10.3673 => 10.8199, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (5.3526 => 5.4291, std. dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (10.4361 => 10.5775, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.02% (22.1758 => 21.7287, std. dev.: 0.0233) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.06% (2.2022 => 2.1788, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 22:47:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 00:47:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614054733.785C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1077?compare_to=1075&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1077, Order: 158440, Start Time: 2012-06-14 04:52:13, End Time: 2012-06-14 05:48:53 To: 1075, Order: 158438, Start Time: 2012-06-14 03:28:58, End Time: 2012-06-14 04:25:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (90 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (759 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2768, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.44% (0.4328 => 0.4520, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4062 => 0.4219, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.74% (0.2781 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (0.3485 => 0.3612, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1047, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.49% (1.3693 => 1.4171, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.48% (2.1791 => 2.2549, std. dev.: 0.0127) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.5818 => 0.6020, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.3899 => 0.4033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.42% (0.5265 => 0.5445, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.41% (0.3022 => 0.3125, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.35% (1.9828 => 2.0492, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.24% (0.3489 => 0.3602, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.24% (1.2292 => 1.2690, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3245 => 1.3673, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.20% (0.5748 => 0.5932, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.18% (0.3580 => 0.3694, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.17% (0.7038 => 0.7261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 3.02% (0.7061 => 0.7274, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.4016 => 0.4137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.98% (0.3453 => 0.3556, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1065, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (1.1364 => 1.1688, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.82% (13.8202 => 14.2094, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4390 => 0.4513, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2523, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.70% (0.7710 => 0.7918, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (3.8646 => 3.9667, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.3868 => 0.3970, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (13.2842 => 13.6271, std. dev.: 0.0140) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1326, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.4563 => 1.4910, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.28% (1.9270 => 1.9709, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.99% (1.3819 => 1.4094, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.97% (1.3813 => 1.4085, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0651, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7211, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.41% (0.8698 => 0.8821, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4747, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7242, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6515, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3085, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7361, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5173, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1443, std. dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 1.40% (1.2308 => 1.2480, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.19% (4.5928 => 4.6476, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.62% (0.4657 => 0.3650, std. dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9533, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.3623 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -2.76% (0.3663 => 0.3562, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.59% (0.3940 => 0.3838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6029, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1232, std. dev.: 0.0499) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9147, std. dev.: 0.0615) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6990, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5106, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1701, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 13 22:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 00:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614055949.BC0FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1078?compare_to=1073&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1078, Order: 158440, Start Time: 2012-06-14 03:45:50, End Time: 2012-06-14 06:01:09 To: 1073, Order: 158426, Start Time: 2012-06-14 01:04:21, End Time: 2012-06-14 03:19:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Unchanged Tests: 894 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 9.41% (0.3792 => 0.4149, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0673 => 2.1027, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.53% (23.5202 => 23.8794, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.34% (0.9909 => 1.0042, std. dev.: 0.0004) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 00:27:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 02:27:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614072739.82E822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1079?compare_to=1077&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1079, Order: 158441, Start Time: 2012-06-14 06:29:37, End Time: 2012-06-14 07:28:59 To: 1077, Order: 158440, Start Time: 2012-06-14 04:52:13, End Time: 2012-06-14 05:48:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.82% (2.0176 => 2.2762, std. dev.: 0.0478) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4328 => 0.4525, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4062 => 0.4219, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2782 => 0.2884, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.53% (1.3693 => 1.4177, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3485 => 0.3608, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 3.45% (0.5818 => 0.6019, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.22% (0.5748 => 0.5933, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2492, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 3.21% (0.7038 => 0.7264, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.2292 => 1.2683, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.06% (0.4016 => 0.4139, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.05% (16.6129 => 17.1204, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3453 => 0.3557, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2263, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (0.3756 => 0.3858, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.71% (0.4390 => 0.4509, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.3868 => 0.3970, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.38% (1.1061 => 1.1324, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9701, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.44% (0.7506 => 0.7614, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0637, std. dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.8698 => 0.8815, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4738, std. dev.: 0.0197) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6517, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1221, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.13% (0.1824 => 0.3541, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2699, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 7.83% (1.2998 => 1.4016, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5192, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0253) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1438, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 1.29% (1.2308 => 1.2467, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.20% (4.5928 => 4.6481, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9666, std. dev.: 0.4284) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.93% (0.3650 => 0.3543, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.84% (0.3663 => 0.3559, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.64% (0.3940 => 0.3836, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5941, std. dev.: 0.0526) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.24% (9.3358 => 9.1268, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8936, std. dev.: 0.0400) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6956, std. dev.: 0.0176) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5155, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1642, std. dev.: 0.0555) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8731, std. dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 00:33:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 02:33:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614073316.07DE52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1080?compare_to=1076&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1080, Order: 158441, Start Time: 2012-06-14 06:29:45, End Time: 2012-06-14 07:34:36 To: 1076, Order: 158440, Start Time: 2012-06-14 04:04:37, End Time: 2012-06-14 05:05:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.49% (10.3673 => 10.8328, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (10.4361 => 10.5839, std. dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.94% (22.1758 => 21.7451, std. dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 01:47:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 03:47:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614084733.026B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1081?compare_to=1078&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1081, Order: 158441, Start Time: 2012-06-14 06:29:26, End Time: 2012-06-14 08:48:51 To: 1078, Order: 158440, Start Time: 2012-06-14 03:45:50, End Time: 2012-06-14 06:01:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Unchanged Tests: 894 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.46% (23.5202 => 23.8647, std. dev.: 0.0200) MultiSource/Applications/hexxagon/hexxagon: 1.32% (0.9909 => 1.0040, std. dev.: 0.0004) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 01:50:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 03:50:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614085057.865CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1082?compare_to=1079&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1082, Order: 158443, Start Time: 2012-06-14 07:55:33, End Time: 2012-06-14 08:52:17 To: 1079, Order: 158441, Start Time: 2012-06-14 06:29:37, End Time: 2012-06-14 07:28:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (758 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2770, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (0.4328 => 0.4535, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4062 => 0.4223, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.88% (0.2781 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2966 => 0.3074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.62% (0.3899 => 0.4040, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3022 => 0.3131, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.57% (1.3693 => 1.4182, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1058, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5265 => 0.5450, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3489 => 0.3611, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.2937 => 0.3039, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.41% (2.1791 => 2.2533, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 3.39% (0.5818 => 0.6015, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.38% (0.3580 => 0.3701, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.3245 => 1.3686, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.32% (1.2292 => 1.2700, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (1.9828 => 2.0486, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5748 => 0.5934, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7038 => 0.7263, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 3.18% (16.6129 => 17.1405, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3149 => 0.3249, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4016 => 0.4143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.07% (0.3453 => 0.3559, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.06% (0.7061 => 0.7277, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.7710 => 0.7940, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2262, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2534, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (3.8646 => 3.9700, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.3868 => 0.3972, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.62% (0.4390 => 0.4505, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1348, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6186, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 2.41% (1.9270 => 1.9734, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.4563 => 1.4908, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4096, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (1.3813 => 1.4082, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.44% (0.7506 => 0.7614, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0669, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (3.6692 => 3.7214, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (0.8698 => 0.8816, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4796, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7248, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6493, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2218, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (7.2180 => 7.2921, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.20% (1.8175 => 2.2755, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.04% (1.2998 => 1.3913, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7298, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1486, std. dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9530, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6454, std. dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9748, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.94% (0.3601 => 0.3495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.85% (0.3650 => 0.3546, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5918, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9581, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -2.21% (9.3358 => 9.1294, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9730, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0040, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2497, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1897, std. dev.: 0.0195) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 02:01:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 04:01:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614090129.E14762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1083?compare_to=1080&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1083, Order: 158443, Start Time: 2012-06-14 08:01:35, End Time: 2012-06-14 09:02:49 To: 1080, Order: 158441, Start Time: 2012-06-14 06:29:45, End Time: 2012-06-14 07:34:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.38% (10.3673 => 10.8215, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.40% (10.4361 => 10.5820, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.39% (5.3526 => 5.4269, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.04% (22.1758 => 21.7234, std. dev.: 0.0272) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.05% (2.2022 => 2.1790, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 04:29:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 06:29:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614112934.583CF2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1084?compare_to=1081&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1084, Order: 158443, Start Time: 2012-06-14 09:15:16, End Time: 2012-06-14 11:30:55 To: 1081, Order: 158441, Start Time: 2012-06-14 06:29:26, End Time: 2012-06-14 08:48:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Unchanged Tests: 894 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (2.0673 => 2.1040, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.45% (23.5202 => 23.8611, std. dev.: 0.0201) MultiSource/Applications/hexxagon/hexxagon: 1.34% (0.9909 => 1.0042, std. dev.: 0.0012) Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 05:14:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 07:14:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614121448.F3A812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1085?compare_to=1082&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1085, Order: 158445, Start Time: 2012-06-14 11:19:32, End Time: 2012-06-14 12:16:09 To: 1082, Order: 158443, Start Time: 2012-06-14 07:55:33, End Time: 2012-06-14 08:52:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (89 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (761 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2778, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4328 => 0.4525, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.4062 => 0.4222, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.74% (0.2781 => 0.2885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.71% (0.9199 => 0.9540, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (0.3485 => 0.3613, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (3.9660 => 4.1106, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3899 => 0.4039, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5265 => 0.5454, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.58% (1.3693 => 1.4183, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.47% (0.3022 => 0.3127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.5818 => 0.6017, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2708, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3489 => 0.3607, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.34% (1.9828 => 2.0491, std. dev.: 0.0111) SingleSource/UnitTests/ObjC++/Hello: 3.34% (0.5748 => 0.5940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3580 => 0.3697, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.25% (0.5637 => 0.5820, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 3.22% (16.6129 => 17.1479, std. dev.: 0.0195) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.7038 => 0.7262, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 3.07% (0.7061 => 0.7278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.4016 => 0.4138, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2325, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3453 => 0.3555, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.2193 => 1.2539, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9715, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.71% (0.3868 => 0.3973, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1348, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6183, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4390 => 0.4498, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9739, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.4563 => 1.4897, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.60% (0.7506 => 0.7626, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7277, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.55% (14.8535 => 15.0837, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.8698 => 0.8817, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.35% (33.2944 => 33.7443, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4757, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6528, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.2742 => 3.3102, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1226, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7309, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.54% (12.0921 => 12.5200, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1430, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9290 => 1.9562, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6450, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.74% (0.4657 => 0.3691, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9649, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.88% (0.3650 => 0.3545, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -2.80% (0.3601 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.15% (0.3139 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0117) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5986, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -2.15% (9.3358 => 9.1354, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9429, std. dev.: 0.0333) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7017, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1686, std. dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 05:19:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 07:19:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614121926.16F602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1086?compare_to=1083&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1086, Order: 158445, Start Time: 2012-06-14 11:19:46, End Time: 2012-06-14 12:20:47 To: 1083, Order: 158443, Start Time: 2012-06-14 08:01:35, End Time: 2012-06-14 09:02:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.41% (10.3673 => 10.8241, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (5.3526 => 5.4316, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (10.4361 => 10.5789, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.97% (22.1758 => 21.7383, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.14% (2.2022 => 2.1772, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 07:00:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 09:00:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614140054.60CD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1087?compare_to=1085&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1087, Order: 158446, Start Time: 2012-06-14 13:05:21, End Time: 2012-06-14 14:02:15 To: 1085, Order: 158445, Start Time: 2012-06-14 11:19:32, End Time: 2012-06-14 12:16:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (91 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (761 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.34% (7.9380 => 8.0447, std. dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2779, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4328 => 0.4525, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.81% (0.2781 => 0.2887, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.79% (0.4062 => 0.4216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.77% (0.3899 => 0.4046, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (0.3485 => 0.3613, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2782 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9199 => 0.9533, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.6959 => 0.7211, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1094, std. dev.: 0.0100) MultiSource/Applications/hbd/hbd: 3.56% (1.3693 => 1.4181, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2966 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.2937 => 0.3039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.44% (0.5818 => 0.6018, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.41% (0.3022 => 0.3125, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (1.9828 => 2.0487, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.32% (1.2292 => 1.2700, std. dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: 3.29% (0.5748 => 0.5937, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2507, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3680, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.27% (0.7038 => 0.7268, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.24% (0.3489 => 0.3602, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.18% (0.3580 => 0.3694, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.7710 => 0.7954, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.15% (16.6129 => 17.1354, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 3.12% (0.7061 => 0.7281, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4016 => 0.4140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3453 => 0.3555, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2164, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.75% (3.8646 => 3.9708, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.3868 => 0.3970, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1348, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4390 => 0.4503, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (13.2842 => 13.6171, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.4563 => 1.4920, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9716, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.04% (1.3813 => 1.4095, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.3819 => 1.4101, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.55% (0.7506 => 0.7622, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.51% (14.8535 => 15.0773, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7208, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (0.8698 => 0.8820, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4894, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7395, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6509, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3085, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std. dev.: 0.0387) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0166) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7306, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5188, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.05% (7.9275 => 8.1689, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.5184 => 0.5308, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 1.23% (10.7476 => 10.8793, std. dev.: 0.0423) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6445, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.72% (0.4657 => 0.3832, std. dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9643, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.85% (0.3650 => 0.3546, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -2.83% (0.3601 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.73% (0.6576 => 0.6462, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5877, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9567, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -2.30% (9.3358 => 9.1211, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9455, std. dev.: 0.0370) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7010, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2540, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1686, std. dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2492, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 07:07:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 09:07:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614140734.BD15C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1088?compare_to=1086&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1088, Order: 158446, Start Time: 2012-06-14 13:07:56, End Time: 2012-06-14 14:08:56 To: 1086, Order: 158445, Start Time: 2012-06-14 11:19:46, End Time: 2012-06-14 12:20:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.41% (10.3673 => 10.8241, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (5.3526 => 5.4286, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (10.4361 => 10.5786, std. dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.00% (22.1758 => 21.7312, std. dev.: 0.0240) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (2.2022 => 2.1775, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 07:11:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 09:11:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614141115.EBD2F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1089?compare_to=1084&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1089, Order: 158445, Start Time: 2012-06-14 11:57:12, End Time: 2012-06-14 14:12:37 To: 1084, Order: 158443, Start Time: 2012-06-14 09:15:16, End Time: 2012-06-14 11:30:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Unchanged Tests: 894 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.55% (0.3792 => 0.4268, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.88% (2.0673 => 2.1061, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.64% (0.9909 => 1.0072, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.46% (23.5202 => 23.8637, std. dev.: 0.0087) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 09:24:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 11:24:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614162455.841672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1090?compare_to=1087&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1090, Order: 158453, Start Time: 2012-06-14 15:29:34, End Time: 2012-06-14 16:26:16 To: 1087, Order: 158446, Start Time: 2012-06-14 13:05:21, End Time: 2012-06-14 14:02:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (91 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (761 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.53% (0.4328 => 0.4524, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.4062 => 0.4218, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3485 => 0.3617, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.64% (1.3693 => 1.4192, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2782 => 0.2883, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1098, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.2781 => 0.2881, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3899 => 0.4039, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3022 => 0.3130, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3245 => 1.3707, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.5818 => 0.6017, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2292 => 1.2697, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0594 => 1.0939, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2498, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3580 => 0.3696, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.24% (0.3489 => 0.3602, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.22% (0.5748 => 0.5933, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7038 => 0.7263, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.17% (1.9828 => 2.0457, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 3.10% (0.7061 => 0.7280, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1278, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.96% (0.4016 => 0.4135, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2253, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sieve: 2.92% (0.3453 => 0.3554, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9735, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.7710 => 0.7924, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.61% (0.3868 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.2842 => 13.6252, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 2.53% (1.1061 => 1.1341, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9738, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.41% (0.4390 => 0.4496, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4913, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.14% (1.3813 => 1.4108, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.73% (0.7506 => 0.7636, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.51% (14.8535 => 15.0778, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.47% (3.6692 => 3.7233, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4772, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.27% (33.2944 => 33.7172, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.24% (0.8698 => 0.8806, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6525, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3082, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.87% (1.2998 => 1.4021, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7391, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5858, std. dev.: 0.0252) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.81% (7.9275 => 8.1502, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2308 => 1.2463, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6440, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9738, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.90% (0.3623 => 0.3518, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.85% (0.3650 => 0.3546, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -2.81% (0.3663 => 0.3560, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -2.80% (0.3646 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.15% (0.3139 => 0.2946, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5908, std. dev.: 0.0111) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1170, std. dev.: 0.0138) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9567, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9548, std. dev.: 0.0280) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6992, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2580, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1421, std. dev.: 0.0314) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.19% (0.9692 => 0.9577, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 09:29:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 11:29:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614162927.2EA0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1091?compare_to=1088&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1091, Order: 158453, Start Time: 2012-06-14 15:29:38, End Time: 2012-06-14 16:30:49 To: 1088, Order: 158446, Start Time: 2012-06-14 13:07:56, End Time: 2012-06-14 14:08:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 875 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.40% (10.3673 => 10.8230, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (5.3526 => 5.4303, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (10.4361 => 10.5794, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.00% (22.1758 => 21.7326, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.07% (2.2022 => 2.1787, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 09:52:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 11:52:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614165249.2215A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1092?compare_to=1089&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1092, Order: 158446, Start Time: 2012-06-14 14:38:49, End Time: 2012-06-14 16:54:11 To: 1089, Order: 158445, Start Time: 2012-06-14 11:57:12, End Time: 2012-06-14 14:12:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 1 (0 on baseline) Unchanged Tests: 893 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.85% (0.4268 => 0.3933, std. dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (2.0673 => 2.1025, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.48% (23.5202 => 23.8691, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 1.42% (0.9909 => 1.0050, std. dev.: 0.0006) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 11:04:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 13:04:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614180453.3EFAB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1093?compare_to=1090&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1093, Order: 158454, Start Time: 2012-06-14 17:09:28, End Time: 2012-06-14 18:06:14 To: 1090, Order: 158453, Start Time: 2012-06-14 15:29:34, End Time: 2012-06-14 16:26:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (88 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (763 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -2.03% (33.7172 => 33.0317, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.07% (3.8417 => 3.7620, std. dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3357 => 7.2365, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2749, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.48% (0.4328 => 0.4522, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.95% (0.2782 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4062 => 0.4220, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 3.83% (0.5818 => 0.6041, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.81% (0.2781 => 0.2887, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 3.65% (0.5748 => 0.5958, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.63% (0.7710 => 0.7990, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.60% (1.3693 => 1.4186, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.57% (0.3899 => 0.4038, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.2966 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1038, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.47% (0.3022 => 0.3127, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.42% (0.5265 => 0.5445, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 3.37% (0.7061 => 0.7299, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.35% (1.9828 => 2.0493, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.30% (0.3489 => 0.3604, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.27% (1.2292 => 1.2694, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3580 => 0.3695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.3245 => 1.3657, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1283, std. dev.: 0.0176) MultiSource/Applications/siod/siod: 3.09% (2.1791 => 2.2465, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7038 => 0.7252, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0594 => 1.0916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.4016 => 0.4138, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3453 => 0.3557, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.71% (0.4390 => 0.4509, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2523, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.3868 => 0.3972, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (3.8646 => 3.9673, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1872, std. dev.: 0.0186) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.53% (1.1061 => 1.1341, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6106, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.4563 => 1.4901, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9712, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.23% (1.3813 => 1.4121, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4124, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5577 => 0.5698, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.47% (0.7506 => 0.7616, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0485, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7173, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.15% (0.8698 => 0.8798, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3086, std. dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 1.00% (6.5754 => 6.6413, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: 8.86% (1.2998 => 1.4149, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7315, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5189, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.36% (1.7688 => 1.8282, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5847, std. dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1349, std. dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6445, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.32% (0.4657 => 0.3990, std. dev.: 0.0231) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9567, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.83% (0.3601 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: -2.59% (0.3940 => 0.3838, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.87% (2.5089 => 2.4117, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5851, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1113, std. dev.: 0.0111) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9594, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6963, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9701, std. dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2365, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1796, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 11:09:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 13:09:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614180907.5DCD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1094?compare_to=1091&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1094, Order: 158454, Start Time: 2012-06-14 17:09:38, End Time: 2012-06-14 18:10:27 To: 1091, Order: 158453, Start Time: 2012-06-14 15:29:38, End Time: 2012-06-14 16:30:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (2 on baseline) Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 872 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.24% (1.2326 => 1.2479, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.67% (10.3673 => 10.8515, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.38% (5.3526 => 5.4263, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (10.4361 => 10.5702, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.14% (1.1642 => 1.1775, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.22% (22.1758 => 21.6828, std. dev.: 0.0265) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (2.2022 => 2.1777, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 12:27:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 14:27:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614192744.F38D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1095?compare_to=1093&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1095, Order: 158461, Start Time: 2012-06-14 18:32:31, End Time: 2012-06-14 19:29:06 To: 1093, Order: 158454, Start Time: 2012-06-14 17:09:28, End Time: 2012-06-14 18:06:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (82 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.76% (2.2615 => 2.3014, std. dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.72% (1.3693 => 1.4203, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4062 => 0.4210, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1061, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.5818 => 0.6016, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3672, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.20% (0.5748 => 0.5932, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.19% (0.7710 => 0.7956, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.09% (1.2292 => 1.2672, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.3899 => 0.4018, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3489 => 0.3594, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.98% (2.1791 => 2.2440, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.97% (1.9828 => 2.0417, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3580 => 0.3685, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7038 => 0.7241, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0896, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7061 => 0.7261, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9672, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4016 => 0.4122, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.64% (13.8202 => 14.1844, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4390 => 0.4498, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.2842 => 13.6055, std. dev.: 0.0181) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.3819 => 1.4137, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.26% (1.9270 => 1.9706, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.23% (1.3813 => 1.4121, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.51% (0.7506 => 0.7619, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0619, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.8698 => 0.8801, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.5754 => 6.6446, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4280, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.62% (1.8175 => 2.3014, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.23% (2.0200 => 2.1862, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.67% (1.2998 => 1.3995, std. dev.: 0.0113) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7329, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1366, std. dev.: 0.0177) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9523, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6417, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 1.01% (1.2308 => 1.2432, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.61% (0.4657 => 0.3837, std. dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.30% (22.5627 => 20.9167, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.02% (0.6576 => 0.6443, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.01% (33.2944 => 32.9573, std. dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5953, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9566, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -2.21% (9.3358 => 9.1294, std. dev.: 0.0228) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.06% (6.6320 => 6.4957, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9554, std. dev.: 0.0330) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7024, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2610, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2330, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1748, std. dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 12:34:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 14:34:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614193423.49BDD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1096?compare_to=1092&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1096, Order: 158455, Start Time: 2012-06-14 17:20:21, End Time: 2012-06-14 19:35:44 To: 1092, Order: 158446, Start Time: 2012-06-14 14:38:49, End Time: 2012-06-14 16:54:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Unchanged Tests: 894 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.52% (2.0673 => 2.0987, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.38% (23.5202 => 23.8456, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std. dev.: 0.0034) Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 12:36:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 14:36:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614193615.B1A232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1097?compare_to=1094&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1097, Order: 158461, Start Time: 2012-06-14 18:36:58, End Time: 2012-06-14 19:37:37 To: 1094, Order: 158454, Start Time: 2012-06-14 17:09:38, End Time: 2012-06-14 18:10:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.63% (10.3673 => 10.8470, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.46% (10.4361 => 10.5886, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (5.3526 => 5.4282, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.09% (22.1758 => 21.7114, std. dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 13:50:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 15:50:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614205039.688A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1098?compare_to=1095&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1098, Order: 158463, Start Time: 2012-06-14 19:55:27, End Time: 2012-06-14 20:52:00 To: 1095, Order: 158461, Start Time: 2012-06-14 18:32:31, End Time: 2012-06-14 19:29:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (75 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.60% (32.9573 => 33.4859, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.40% (7.2330 => 7.3344, std. dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2731, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4328 => 0.4497, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.49% (0.9199 => 0.9520, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.6959 => 0.7199, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0990, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 3.29% (1.3693 => 1.4144, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 3.20% (0.4062 => 0.4192, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3485 => 0.3586, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.74% (0.3899 => 0.4006, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7038 => 0.7230, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.65% (1.2292 => 1.2618, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.7710 => 0.7914, std. dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 2.64% (16.6129 => 17.0507, std. dev.: 0.0110) MultiSource/Applications/siod/siod: 2.63% (2.1791 => 2.2365, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 2.63% (0.5818 => 0.5971, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.58% (13.8202 => 14.1762, std. dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9613, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (1.9828 => 2.0305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.35% (0.5748 => 0.5883, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.31% (1.1061 => 1.1316, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (1.3813 => 1.4125, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 2.22% (0.7061 => 0.7218, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (13.2842 => 13.5671, std. dev.: 0.0222) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4868, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (1.3819 => 1.4103, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.04% (1.9270 => 1.9663, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.44% (0.7506 => 0.7614, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7163, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0310, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4280, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.46% (1.2998 => 1.3968, std. dev.: 0.0188) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7255, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5862, std. dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1372, std. dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5120, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.09% (4.5928 => 4.6430, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 1.04% (10.7476 => 10.8592, std. dev.: 0.0341) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.38% (0.4657 => 0.3708, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.31% (22.5627 => 20.9128, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.88% (0.3650 => 0.3545, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.76% (0.3663 => 0.3562, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3217, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.48% (1.9762 => 1.9075, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5934, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1233, std. dev.: 0.0352) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9580, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9167, std. dev.: 0.0383) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7011, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2622, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1533, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 14:03:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 16:03:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614210347.028E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1099?compare_to=1097&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1099, Order: 158463, Start Time: 2012-06-14 20:04:04, End Time: 2012-06-14 21:05:08 To: 1097, Order: 158461, Start Time: 2012-06-14 18:36:58, End Time: 2012-06-14 19:37:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 2 (0 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 872 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (10.8470 => 10.7154, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (10.3673 => 10.7154, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.93% (5.3526 => 5.4561, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (10.4361 => 10.5516, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.05% (22.1758 => 21.7205, std. dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.0665 => 2.0446, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 15:13:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 17:13:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614221337.CF38A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1100?compare_to=1098&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1100, Order: 158467, Start Time: 2012-06-14 21:18:19, End Time: 2012-06-14 22:14:59 To: 1098, Order: 158463, Start Time: 2012-06-14 19:55:27, End Time: 2012-06-14 20:52:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.88% (0.4328 => 0.4496, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5265 => 0.5450, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1006, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash: 3.37% (0.4062 => 0.4199, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.23% (1.3693 => 1.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.93% (0.3485 => 0.3587, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.7710 => 0.7930, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.3899 => 0.4008, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2398, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (0.7038 => 0.7233, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.72% (1.2292 => 1.2626, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0594, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9669, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2193 => 1.2515, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1776, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 2.58% (0.5818 => 0.5968, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1364 => 1.1655, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.45% (1.1061 => 1.1332, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (1.9828 => 2.0306, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.35% (0.5748 => 0.5883, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4135, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.25% (0.7061 => 0.7220, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5753, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9679, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.40% (0.7506 => 0.7611, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.35% (3.6692 => 3.7187, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0347, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2904, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.1333 => 1.1459, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4268, std. dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 25.76% (1.8175 => 2.2856, std. dev.: 0.0459) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.14% (2.0200 => 2.1844, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4027, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7242, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5841, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1430, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6437, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.04% (10.7476 => 10.8592, std. dev.: 0.0396) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9350, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.88% (0.3650 => 0.3545, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.30% (0.6576 => 0.6425, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5939, std. dev.: 0.0150) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1187, std. dev.: 0.0298) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9599, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9604, std. dev.: 0.0313) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6969, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2580, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1557, std. dev.: 0.0328) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 15:16:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 17:16:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120614221609.D0E812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1101?compare_to=1096&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1101, Order: 158463, Start Time: 2012-06-14 20:02:07, End Time: 2012-06-14 22:17:31 To: 1096, Order: 158455, Start Time: 2012-06-14 17:20:21, End Time: 2012-06-14 19:35:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Unchanged Tests: 894 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.51% (0.3792 => 0.4380, std. dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std. dev.: 0.0030) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 15:31:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 17:31:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614223112.2A8C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1102?compare_to=1099&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1102, Order: 158469, Start Time: 2012-06-14 21:31:35, End Time: 2012-06-14 22:32:33 To: 1099, Order: 158463, Start Time: 2012-06-14 20:04:04, End Time: 2012-06-14 21:05:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (10.7154 => 10.5464, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (10.3673 => 10.5464, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (5.3526 => 5.4239, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (10.4361 => 10.5417, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.27% (22.1758 => 21.6716, std. dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 16:36:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 18:36:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120614233635.735CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1103?compare_to=1100&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1103, Order: 158472, Start Time: 2012-06-14 22:41:22, End Time: 2012-06-14 23:37:56 To: 1100, Order: 158467, Start Time: 2012-06-14 21:18:19, End Time: 2012-06-14 22:14:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.52% (7.9366 => 8.0569, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.0176 => 2.2702, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4328 => 0.4497, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.6959 => 0.7200, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0978, std. dev.: 0.0094) MultiSource/Applications/hbd/hbd: 3.24% (1.3693 => 1.4137, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.20% (0.4062 => 0.4192, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3647, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.94% (0.7710 => 0.7937, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 2.92% (0.5818 => 0.5988, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.82% (1.2292 => 1.2639, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.68% (0.5748 => 0.5902, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.67% (2.1791 => 2.2372, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7038 => 0.7222, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.59% (0.3899 => 0.4000, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2193 => 1.2504, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.51% (0.7061 => 0.7238, std. dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.50% (13.8202 => 14.1658, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (1.9828 => 2.0323, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.48% (3.8646 => 3.9604, std. dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0222, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.42% (0.5577 => 0.5712, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.28% (1.1061 => 1.1313, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.3819 => 1.4127, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5780, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4111, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.05% (1.9270 => 1.9665, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7154, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0396, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.14% (1.1333 => 1.1462, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2778, std. dev.: 0.0470) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.40% (1.2998 => 1.3960, std. dev.: 0.0078) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7163, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0380) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.85% (7.9275 => 8.1536, std. dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.5184 => 0.5310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6447, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.20% (0.4657 => 0.3763, std. dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8850, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.55% (1.0460 => 0.8624, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6119, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1122, std. dev.: 0.0559) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9212, std. dev.: 0.0938) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6993, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1484, std. dev.: 0.0281) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 16:58:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 18:58:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120614235831.B736C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1104?compare_to=1102&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1104, Order: 158474, Start Time: 2012-06-14 22:59:02, End Time: 2012-06-14 23:59:53 To: 1102, Order: 158469, Start Time: 2012-06-14 21:31:35, End Time: 2012-06-14 22:32:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 874 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (10.5464 => 10.8986, std. dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.12% (10.3673 => 10.8986, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (5.3526 => 5.4247, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (10.4361 => 10.5607, std. dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.18% (22.1758 => 21.6917, std. dev.: 0.0190) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.04% (2.2022 => 2.1792, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 17:57:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 19:57:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615005749.AA26C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1105?compare_to=1101&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1105, Order: 158472, Start Time: 2012-06-14 22:43:49, End Time: 2012-06-15 00:59:12 To: 1101, Order: 158463, Start Time: 2012-06-14 20:02:07, End Time: 2012-06-14 22:17:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (3 on baseline) Unchanged Tests: 893 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.01% (1.5958 => 1.6119, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.17% (1.5932 => 1.6119, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.06% (2.0673 => 2.0892, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.81% (0.2122 => 0.2224, std. dev.: 0.0036) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 17:59:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 19:59:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615005930.45D9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1106?compare_to=1103&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1106, Order: 158478, Start Time: 2012-06-15 00:04:13, End Time: 2012-06-15 01:00:51 To: 1103, Order: 158472, Start Time: 2012-06-14 22:41:22, End Time: 2012-06-14 23:37:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (75 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.05% (2.0176 => 2.2608, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.23% (0.4328 => 0.4511, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4062 => 0.4212, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.59% (1.3693 => 1.4185, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.6959 => 0.7198, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.43% (0.2945 => 0.3046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3899 => 0.4030, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3245 => 1.3673, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.5818 => 0.6006, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0937, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.14% (0.7061 => 0.7283, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 3.10% (0.5748 => 0.5926, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.00% (1.2292 => 1.2661, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3580 => 0.3685, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2422, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 2.88% (16.6129 => 17.0917, std. dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7038 => 0.7240, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3485 => 0.3585, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (1.9828 => 2.0379, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.57% (0.7710 => 0.7908, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.4016 => 0.4119, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (3.8646 => 3.9637, std. dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1609, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6031, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4390 => 0.4494, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.09% (1.9270 => 1.9672, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4038, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0206, std. dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7083, std. dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 1.06% (1.2749 => 1.2884, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6451, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 25.43% (1.8175 => 2.2797, std. dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0120) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7389, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9187, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5190, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1233, std. dev.: 0.0270) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6438, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.06% (0.4657 => 0.3723, std. dev.: 0.0151) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9262, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.19% (0.3601 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.13% (0.3646 => 0.3532, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3663 => 0.3550, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.05% (0.3578 => 0.3469, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3650 => 0.3540, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -2.63% (0.3914 => 0.3811, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6003, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -2.24% (9.3358 => 9.1266, std. dev.: 0.0217) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4981, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9389, std. dev.: 0.0296) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6977, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1601, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 18:25:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 20:25:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615012540.E05542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1107?compare_to=1104&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1107, Order: 158478, Start Time: 2012-06-15 00:26:12, End Time: 2012-06-15 01:27:03 To: 1104, Order: 158474, Start Time: 2012-06-14 22:59:02, End Time: 2012-06-14 23:59:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 873 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.58% (62.8294 => 63.8252, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -5.82% (10.8986 => 10.2645, std. dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (5.3526 => 5.4252, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (10.4361 => 10.5676, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.16% (22.1758 => 21.6961, std. dev.: 0.0140) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 19:22:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 21:22:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615022224.3EE772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1108?compare_to=1106&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1108, Order: 158483, Start Time: 2012-06-15 01:27:14, End Time: 2012-06-15 02:23:45 To: 1106, Order: 158478, Start Time: 2012-06-15 00:04:13, End Time: 2012-06-15 01:00:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 2 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -2.15% (33.6451 => 32.9205, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3402 => 7.2416, std. dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.64% (2.0176 => 2.2726, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.57% (0.4328 => 0.4526, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.56% (1.3693 => 1.4181, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3899 => 0.4031, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0961, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.5818 => 0.6003, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.3245 => 1.3654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.07% (0.3580 => 0.3690, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.98% (0.7038 => 0.7248, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.97% (0.5748 => 0.5919, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1064, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2292 => 1.2650, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3485 => 0.3586, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2419, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 2.79% (0.7061 => 0.7258, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (1.9828 => 2.0366, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4390 => 0.4502, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9619, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.4016 => 0.4117, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (0.7710 => 0.7901, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1559, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.39% (1.1061 => 1.1325, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5795, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9652, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.4563 => 1.4841, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4057, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1333 => 1.1458, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7087, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0129, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2779, std. dev.: 0.0420) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.73% (1.2998 => 1.4003, std. dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7228, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5169, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1366, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5928 => 4.6465, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.68% (0.4657 => 0.3694, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9501, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.25% (0.3601 => 0.3484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.19% (0.3663 => 0.3546, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.19% (0.8818 => 0.8537, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -3.19% (0.3578 => 0.3464, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -3.13% (0.3646 => 0.3532, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.01% (0.3789 => 0.3675, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.12% (33.2944 => 32.9205, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6102, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1183, std. dev.: 0.0352) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9257, std. dev.: 0.0617) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1566, std. dev.: 0.0398) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2416, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 19:52:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 21:52:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615025244.B1B3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1109?compare_to=1107&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1109, Order: 158485, Start Time: 2012-06-15 01:53:24, End Time: 2012-06-15 02:54:03 To: 1107, Order: 158478, Start Time: 2012-06-15 00:26:12, End Time: 2012-06-15 01:27:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 19 (19 on baseline) Unchanged Tests: 872 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.94% (10.2645 => 10.4639, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (5.3526 => 5.4347, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (10.4361 => 10.5462, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.10% (22.1758 => 21.7091, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 20:39:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 22:39:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615033914.B47312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1110?compare_to=1105&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1110, Order: 158483, Start Time: 2012-06-15 01:25:21, End Time: 2012-06-15 03:40:36 To: 1105, Order: 158472, Start Time: 2012-06-14 22:43:49, End Time: 2012-06-15 00:59:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Unchanged Tests: 894 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.27% (1.5932 => 1.6134, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.92% (2.0820 => 2.1220, std. dev.: 0.0040) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 20:45:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 14 Jun 2012 22:45:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615034514.469992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1111?compare_to=1108&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1111, Order: 158485, Start Time: 2012-06-15 02:50:02, End Time: 2012-06-15 03:46:36 To: 1108, Order: 158483, Start Time: 2012-06-15 01:27:14, End Time: 2012-06-15 02:23:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (77 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (766 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2730, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.44% (0.4328 => 0.4520, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4062 => 0.4212, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.56% (1.3693 => 1.4181, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.6959 => 0.7199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3899 => 0.4031, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0984, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 3.13% (0.5818 => 0.6000, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.07% (16.6129 => 17.1230, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.04% (0.3485 => 0.3591, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.01% (0.7038 => 0.7250, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 3.01% (0.5748 => 0.5921, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.99% (2.1791 => 2.2442, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.96% (1.2292 => 1.2656, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.95% (0.3489 => 0.3592, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.91% (0.3580 => 0.3684, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.7710 => 0.7922, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7061 => 0.7253, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (1.9828 => 2.0359, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.4016 => 0.4118, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (3.8646 => 3.9625, std. dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1600, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.41% (0.4390 => 0.4496, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5791, std. dev.: 0.0189) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9670, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (1.3813 => 1.4092, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4057, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0401, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.1333 => 1.1459, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7088, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4309, std. dev.: 0.0174) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/mandel-2: 8.46% (1.2998 => 1.4098, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7167, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1565, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5860, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6449, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.18% (0.4657 => 0.3624, std. dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9483, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.29% (0.3650 => 0.3530, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.19% (0.3663 => 0.3546, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.8818 => 0.8538, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -3.15% (0.3646 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.87% (0.3940 => 0.3827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -2.57% (0.4003 => 0.3900, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.17% (33.2944 => 32.9062, std. dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0151) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6016, std. dev.: 0.0163) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.22% (0.4867 => 0.4759, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -2.19% (9.3358 => 9.1312, std. dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9226, std. dev.: 0.0381) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2388, std. dev.: 0.0137) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1865, std. dev.: 0.0446) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.22% (0.9692 => 0.9574, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 23:03:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 01:03:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615060358.D00DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1112?compare_to=1111&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1112, Order: 158486, Start Time: 2012-06-15 05:08:47, End Time: 2012-06-15 06:05:20 To: 1111, Order: 158485, Start Time: 2012-06-15 02:50:02, End Time: 2012-06-15 03:46:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (75 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (768 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2735, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.44% (0.4328 => 0.4520, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.61% (1.3693 => 1.4188, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3899 => 0.4039, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.4062 => 0.4203, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.6959 => 0.7198, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0985, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 3.21% (0.5818 => 0.6005, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3667, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1276, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (1.9828 => 2.0418, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 2.97% (1.2292 => 1.2657, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: 2.96% (0.5748 => 0.5918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.96% (0.3485 => 0.3588, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2421, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3580 => 0.3683, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7061 => 0.7259, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.7710 => 0.7916, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (3.8646 => 3.9640, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.4016 => 0.4119, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1697, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4390 => 0.4497, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5848, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9671, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4054, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0266, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7101, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2732, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.64% (2.0200 => 2.1946, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7312, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5165, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1281, std. dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6462, std. dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.66% (0.4657 => 0.3695, std. dev.: 0.0324) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9533, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.30% (0.3601 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.29% (0.3650 => 0.3530, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: -3.19% (0.3663 => 0.3546, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.15% (0.3646 => 0.3531, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4003 => 0.3901, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.16% (33.2944 => 32.9092, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5949, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1115, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9576, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8975, std. dev.: 0.0387) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4999, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2592, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0031) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1750, std. dev.: 0.0239) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2375, std. dev.: 0.0240) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 23:08:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 01:08:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615060801.2166A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1113?compare_to=1109&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1113, Order: 158486, Start Time: 2012-06-15 05:08:48, End Time: 2012-06-15 06:09:23 To: 1109, Order: 158485, Start Time: 2012-06-15 01:53:24, End Time: 2012-06-15 02:54:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9425 => 8.0417, std. dev.: 0.0244) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.46% (5.3526 => 5.4307, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (10.4361 => 10.5469, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.07% (22.1758 => 21.7157, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 14 23:20:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 01:20:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615062035.6C51E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1114?compare_to=1110&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1114, Order: 158485, Start Time: 2012-06-15 04:06:44, End Time: 2012-06-15 06:21:58 To: 1110, Order: 158483, Start Time: 2012-06-15 01:25:21, End Time: 2012-06-15 03:40:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (0 on baseline) Unchanged Tests: 893 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.23% (2.1220 => 2.0746, std. dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.23% (1.5932 => 1.6128, std. dev.: 0.0006) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 00:30:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 02:30:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615073013.E01B62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1115?compare_to=1112&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1115, Order: 158489, Start Time: 2012-06-15 06:31:45, End Time: 2012-06-15 07:31:35 To: 1112, Order: 158486, Start Time: 2012-06-15 05:08:47, End Time: 2012-06-15 06:05:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (811 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.67% (2.0176 => 2.2733, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4328 => 0.4507, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.37% (0.4062 => 0.4199, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.28% (0.3899 => 0.4027, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 2.77% (0.5818 => 0.5979, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 2.68% (0.5748 => 0.5902, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (0.7038 => 0.7220, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.48% (0.7061 => 0.7236, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.33% (13.8202 => 14.1422, std. dev.: 0.0104) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.94% (1.9270 => 1.9644, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0139, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.49% (1.8175 => 2.2808, std. dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0113) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7371, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9223, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5863, std. dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1302, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.5184 => 0.5295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.80% (0.8273 => 0.8422, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0406) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.30% (2.0152 => 2.0414, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6454, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9490, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-2: -3.44% (0.3601 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.26% (33.2944 => 32.8748, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0231) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0087) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9998, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.5254 => 2.4872, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (0.9692 => 0.9570, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2495, std. dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 00:37:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 02:37:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615073743.982BC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1116?compare_to=1113&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1116, Order: 158489, Start Time: 2012-06-15 06:35:51, End Time: 2012-06-15 07:39:05 To: 1113, Order: 158486, Start Time: 2012-06-15 05:08:48, End Time: 2012-06-15 06:09:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (10.4670 => 10.7135, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (10.3673 => 10.7135, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (5.3526 => 5.4240, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 01:53:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 03:53:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615085330.3797E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1117?compare_to=1115&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1117, Order: 158498, Start Time: 2012-06-15 07:58:16, End Time: 2012-06-15 08:54:51 To: 1115, Order: 158489, Start Time: 2012-06-15 06:31:45, End Time: 2012-06-15 07:31:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 2 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (771 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.78% (0.5783 => 0.5680, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.35% (3.8858 => 3.7943, std. dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.74% (2.0176 => 2.2746, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.90% (0.4328 => 0.4497, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.38% (1.3693 => 1.4156, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.27% (0.4062 => 0.4195, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0953, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.22% (0.6959 => 0.7183, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3655, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.92% (0.5818 => 0.5988, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.77% (0.3899 => 0.4007, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.70% (16.6129 => 17.0618, std. dev.: 0.0120) SingleSource/UnitTests/ObjC++/Hello: 2.70% (0.5748 => 0.5903, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2377, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.7710 => 0.7912, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.60% (1.2292 => 1.2612, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 2.45% (0.7061 => 0.7234, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (1.9828 => 2.0306, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9550, std. dev.: 0.0113) MultiSource/Applications/Burg/burg: 2.28% (1.1061 => 1.1313, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.27% (13.8202 => 14.1343, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5808, std. dev.: 0.0215) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4039, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4045, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0229, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7066, std. dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 27.01% (1.8175 => 2.3084, std. dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7298, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5836, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1351, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6443, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9015, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3623 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.51% (0.3650 => 0.3522, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.8818 => 0.8515, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: -3.35% (0.3578 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.11% (0.3789 => 0.3671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.6576 => 0.6387, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: -2.72% (0.4003 => 0.3894, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.26% (33.2944 => 32.8753, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5911, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1177, std. dev.: 0.0386) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9625, std. dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1356, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2325, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.16% (0.9692 => 0.9580, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 02:04:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 04:04:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615090407.40D622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1118?compare_to=1114&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1118, Order: 158489, Start Time: 2012-06-15 06:48:07, End Time: 2012-06-15 09:05:29 To: 1114, Order: 158485, Start Time: 2012-06-15 04:06:44, End Time: 2012-06-15 06:21:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.29% (2.8036 => 2.8397, std. dev.: 0.0080) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 02:05:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 04:05:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615090511.257312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1119?compare_to=1116&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1119, Order: 158498, Start Time: 2012-06-15 08:05:48, End Time: 2012-06-15 09:06:33 To: 1116, Order: 158489, Start Time: 2012-06-15 06:35:51, End Time: 2012-06-15 07:39:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (10.7135 => 10.3440, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.55% (5.3526 => 5.4354, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.10% (22.1758 => 21.7100, std. dev.: 0.0230) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 03:16:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 05:16:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615101607.D8A112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1120?compare_to=1117&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1120, Order: 158508, Start Time: 2012-06-15 09:20:59, End Time: 2012-06-15 10:17:29 To: 1117, Order: 158498, Start Time: 2012-06-15 07:58:16, End Time: 2012-06-15 08:54:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2697, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4328 => 0.4489, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.36% (1.3693 => 1.4153, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9199 => 0.9505, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0924, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.4062 => 0.4189, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3655, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.5818 => 0.5982, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.65% (2.1791 => 2.2369, std. dev.: 0.0156) SingleSource/UnitTests/ObjC++/Hello: 2.59% (0.5748 => 0.5897, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0305, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.7710 => 0.7899, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.42% (1.2292 => 1.2589, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1364 => 1.1632, std. dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: 2.32% (0.7061 => 0.7225, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (1.9828 => 2.0280, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5840, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1294, std. dev.: 0.0132) MultiSource/Applications/Burg/burg: 2.22% (1.1061 => 1.1307, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (3.8646 => 3.9505, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9639, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.4563 => 1.4834, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.58% (1.3813 => 1.4031, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.54% (1.3819 => 1.4032, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0240, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.48% (1.8175 => 2.2806, std. dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.22% (0.9996 => 1.0818, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.70% (1.2998 => 1.3869, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0369) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1398, std. dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6457, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.66% (0.4657 => 0.3555, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8565, std. dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.8818 => 0.8524, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3623 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.07% (0.3650 => 0.3538, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.03% (0.3601 => 0.3492, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3646 => 0.3536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.91% (0.3578 => 0.3474, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.67% (0.3789 => 0.3688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.98% (0.9108 => 0.8928, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.74% (33.2944 => 32.7143, std. dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.50% (1.9762 => 1.9070, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std. dev.: 0.0282) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.29% (9.3358 => 9.1222, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9418, std. dev.: 0.0434) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6974, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1328, std. dev.: 0.0212) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2297, std. dev.: 0.0269) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8483, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 03:32:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 05:32:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615103204.3D3532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1121?compare_to=1119&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1121, Order: 158510, Start Time: 2012-06-15 09:32:56, End Time: 2012-06-15 10:33:26 To: 1119, Order: 158498, Start Time: 2012-06-15 08:05:48, End Time: 2012-06-15 09:06:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.81% (10.3440 => 10.8416, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.90% (3.7777 => 3.9250, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.57% (10.3673 => 10.8416, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (5.3526 => 5.4328, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (10.4361 => 10.5712, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.89% (3.7781 => 3.9250, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.15% (22.1758 => 21.6983, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 04:38:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 06:38:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615113848.C54452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1122?compare_to=1120&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1122, Order: 158513, Start Time: 2012-06-15 10:43:41, End Time: 2012-06-15 11:40:11 To: 1120, Order: 158508, Start Time: 2012-06-15 09:20:59, End Time: 2012-06-15 10:17:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4328 => 0.4487, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.49% (1.3693 => 1.4171, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.6959 => 0.7181, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (3.9660 => 4.0891, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3647, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.95% (0.4062 => 0.4182, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.5818 => 0.5982, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.75% (0.5748 => 0.5906, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.7710 => 0.7914, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2335, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.47% (16.6129 => 17.0225, std. dev.: 0.0135) SingleSource/UnitTests/ObjC++/property-reference: 2.42% (0.7061 => 0.7232, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.2292 => 1.2586, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.2193 => 1.2476, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.26% (13.8202 => 14.1328, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (1.9828 => 2.0267, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5771, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9488, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.17% (1.1061 => 1.1301, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.92% (1.9270 => 1.9640, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4832, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (3.6692 => 3.7105, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.06% (14.8535 => 15.0109, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2684, std. dev.: 0.0271) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7293, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9235, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1400, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6401, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.89% (0.4657 => 0.3684, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.5627 => 20.8528, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.07% (0.3650 => 0.3538, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.00% (0.3601 => 0.3493, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: -2.93% (0.3646 => 0.3539, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.91% (0.3578 => 0.3474, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.04% (0.9108 => 0.8922, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.73% (33.2944 => 32.7174, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0166) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1162, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4973, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9356, std. dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7001, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2596, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1609, std. dev.: 0.0396) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2380, std. dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 04:45:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 06:45:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615114555.DE3122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1123?compare_to=1118&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1123, Order: 158510, Start Time: 2012-06-15 09:31:51, End Time: 2012-06-15 11:47:17 To: 1118, Order: 158489, Start Time: 2012-06-15 06:48:07, End Time: 2012-06-15 09:05:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.03% (23.5202 => 23.7614, std. dev.: 0.0246) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 04:58:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 06:58:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615115855.E86792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1124?compare_to=1121&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1124, Order: 158513, Start Time: 2012-06-15 10:59:47, End Time: 2012-06-15 12:00:18 To: 1121, Order: 158510, Start Time: 2012-06-15 09:32:56, End Time: 2012-06-15 10:33:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.46% (10.3673 => 10.8301, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (5.3526 => 5.4343, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (10.4361 => 10.5618, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.11% (22.1758 => 21.7084, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 07:27:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 09:27:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615142735.857142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1125?compare_to=1123&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1125, Order: 158513, Start Time: 2012-06-15 12:13:37, End Time: 2012-06-15 14:28:58 To: 1123, Order: 158510, Start Time: 2012-06-15 09:31:51, End Time: 2012-06-15 11:47:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Unchanged Tests: 894 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.08% (23.5202 => 23.7752, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0011) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 08:03:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 10:03:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615150347.3E28B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1126?compare_to=1122&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1126, Order: 158521, Start Time: 2012-06-15 14:08:44, End Time: 2012-06-15 15:05:10 To: 1122, Order: 158513, Start Time: 2012-06-15 10:43:41, End Time: 2012-06-15 11:40:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (779 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.59% (7.9301 => 8.0561, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (2.0176 => 2.2694, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.72% (0.4328 => 0.4489, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.44% (1.3693 => 1.4164, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (3.9660 => 4.0916, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4062 => 0.4185, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.92% (0.5818 => 0.5988, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.61% (0.5748 => 0.5898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0304, std. dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: 2.49% (0.7038 => 0.7213, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.48% (2.1791 => 2.2332, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.7710 => 0.7898, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2292 => 1.2591, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.41% (0.7061 => 0.7231, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.2193 => 1.2478, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.28% (1.1364 => 1.1623, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5823, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (3.8646 => 3.9510, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (1.9828 => 2.0267, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.19% (13.8202 => 14.1223, std. dev.: 0.0156) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.61% (1.3813 => 1.4035, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0125, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.56% (1.2998 => 1.3851, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.86% (7.4271 => 7.7141, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5191, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.92% (7.9275 => 8.1593, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6458, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.63% (0.4657 => 0.3603, std. dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.5627 => 20.8638, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.38% (0.8818 => 0.8520, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3623 => 0.3511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.07% (0.3650 => 0.3538, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.00% (0.3601 => 0.3493, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.93% (0.3646 => 0.3539, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.93% (0.3578 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.67% (0.3789 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.6576 => 0.6412, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.93% (0.9108 => 0.8932, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.76% (33.2944 => 32.7078, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5900, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1137, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9601, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (20.3410 => 19.9028, std. dev.: 0.0168) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.08% (6.6320 => 6.4940, std. dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7011, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2601, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1539, std. dev.: 0.0256) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2339, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 08:08:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 10:08:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615150805.572522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1127?compare_to=1124&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1127, Order: 158521, Start Time: 2012-06-15 14:08:48, End Time: 2012-06-15 15:09:27 To: 1124, Order: 158513, Start Time: 2012-06-15 10:59:47, End Time: 2012-06-15 12:00:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.55% (10.3673 => 10.8391, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (5.3526 => 5.4296, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (10.4361 => 10.5602, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.11% (22.1758 => 21.7089, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 09:26:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 11:26:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615162620.44A362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1128?compare_to=1126&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1128, Order: 158523, Start Time: 2012-06-15 15:31:17, End Time: 2012-06-15 16:27:42 To: 1126, Order: 158521, Start Time: 2012-06-15 14:08:44, End Time: 2012-06-15 15:05:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2689, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.16% (0.4328 => 0.4508, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.86% (1.3693 => 1.4222, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4062 => 0.4208, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0922, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.08% (0.3899 => 0.4019, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (1.9828 => 2.0415, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3630, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3485 => 0.3586, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.89% (0.5818 => 0.5986, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.89% (0.3534 => 0.3636, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7038 => 0.7241, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2292 => 1.2645, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0493, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2358, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.59% (0.5748 => 0.5897, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1469, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2193 => 1.2481, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.2842 => 13.5937, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (3.8646 => 3.9503, std. dev.: 0.0087) MultiSource/Applications/Burg/burg: 2.17% (1.1061 => 1.1301, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9658, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.4563 => 1.4836, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0149, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7089, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1333 => 1.1453, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.96% (1.8175 => 2.2894, std. dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.22% (2.0200 => 2.1860, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 7.50% (1.2998 => 1.3973, std. dev.: 0.0085) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7266, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1355, std. dev.: 0.0091) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9553, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6432, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.74% (0.4657 => 0.3598, std. dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.5627 => 20.9187, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3601 => 0.3458, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.94% (0.9108 => 0.8931, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.37% (33.2944 => 32.8398, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6047, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9566, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.27% (20.3410 => 19.8797, std. dev.: 0.0573) MultiSource/Applications/minisat/minisat: -2.22% (9.3358 => 9.1290, std. dev.: 0.0274) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6995, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0086) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1325, std. dev.: 0.0268) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2375, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2517, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 09:34:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 11:34:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615163455.702512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1129?compare_to=1127&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1129, Order: 158523, Start Time: 2012-06-15 15:35:45, End Time: 2012-06-15 16:36:16 To: 1127, Order: 158521, Start Time: 2012-06-15 14:08:48, End Time: 2012-06-15 15:09:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (871 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.53% (10.8391 => 10.3486, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (5.3526 => 5.4226, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.41% (22.1758 => 21.6412, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 10:09:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 12:09:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615170900.847852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1130?compare_to=1125&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1130, Order: 158523, Start Time: 2012-06-15 14:55:07, End Time: 2012-06-15 17:10:23 To: 1125, Order: 158513, Start Time: 2012-06-15 12:13:37, End Time: 2012-06-15 14:28:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Unchanged Tests: 894 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.92% (0.3792 => 0.4244, std. dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 1.40% (1.5932 => 1.6155, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std. dev.: 0.0019) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 11:30:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 13:30:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615183004.39B8D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1131?compare_to=1128&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1131, Order: 158525, Start Time: 2012-06-15 17:34:53, End Time: 2012-06-15 18:31:27 To: 1128, Order: 158523, Start Time: 2012-06-15 15:31:17, End Time: 2012-06-15 16:27:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (771 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4328 => 0.4505, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4062 => 0.4214, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.64% (1.3693 => 1.4191, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.28% (0.3899 => 0.4027, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.28% (0.6959 => 0.7187, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9199 => 0.9495, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3580 => 0.3685, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3245 => 1.3629, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (1.9828 => 2.0397, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7038 => 0.7234, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.76% (1.2292 => 1.2631, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0641, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2358, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 2.56% (0.5818 => 0.5967, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1591, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 2.33% (0.5748 => 0.5882, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5757, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9491, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 2.17% (0.7061 => 0.7214, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.03% (1.9270 => 1.9662, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.55% (1.3819 => 1.4033, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0260, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7064, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.45% (1.8175 => 2.2801, std. dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4036, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7184, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0223) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1358, std. dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2459, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.76% (0.4657 => 0.3690, std. dev.: 0.0211) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9442, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.42% (0.3646 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.3789 => 0.3633, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.6576 => 0.6420, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -1.38% (33.2944 => 32.8355, std. dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (6.2785 => 6.2147, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5892, std. dev.: 0.0216) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.33% (20.3410 => 19.8678, std. dev.: 0.0818) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1231, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9605, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6970, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5140, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2305, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1819, std. dev.: 0.0135) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 11:36:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 13:36:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615183629.9921D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1132?compare_to=1129&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1132, Order: 158525, Start Time: 2012-06-15 17:37:22, End Time: 2012-06-15 18:37:52 To: 1129, Order: 158523, Start Time: 2012-06-15 15:35:45, End Time: 2012-06-15 16:36:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.95% (10.3486 => 10.5507, std. dev.: 0.0126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (5.3526 => 5.4556, std. dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 1.77% (10.3673 => 10.5507, std. dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.18% (22.1758 => 21.6922, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (2.0665 => 2.0454, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 12:51:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 14:51:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615195119.1CB3C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1133?compare_to=1130&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1133, Order: 158525, Start Time: 2012-06-15 17:37:14, End Time: 2012-06-15 19:52:41 To: 1130, Order: 158523, Start Time: 2012-06-15 14:55:07, End Time: 2012-06-15 17:10:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (2.7292 => 2.7008, std. dev.: 0.0021) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 12:53:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 14:53:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615195304.2245F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1134?compare_to=1131&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1134, Order: 158533, Start Time: 2012-06-15 18:57:38, End Time: 2012-06-15 19:54:26 To: 1131, Order: 158525, Start Time: 2012-06-15 17:34:53, End Time: 2012-06-15 18:31:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (76 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (767 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.24% (2.0176 => 2.2847, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (3.9660 => 4.1109, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.63% (0.4328 => 0.4485, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.36% (1.3693 => 1.4153, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2472, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.12% (16.6129 => 17.1310, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.7038 => 0.7255, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4062 => 0.4186, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.84% (13.8202 => 14.2128, std. dev.: 0.0941) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9676, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.64% (0.3899 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.45% (1.1061 => 1.1332, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.2842 => 13.6068, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.7710 => 0.7893, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.31% (1.2292 => 1.2576, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.31% (1.3819 => 1.4138, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9707, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference-object: 2.25% (0.5818 => 0.5949, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.7460 => 0.7621, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 2.04% (0.5748 => 0.5865, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (1.9828 => 2.0224, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 1.88% (0.7061 => 0.7194, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.1333 => 1.1496, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (3.6692 => 3.7206, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.37% (14.8535 => 15.0566, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4561, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6465, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3087, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.00% (2.1007 => 2.1218, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0451) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.73% (2.0200 => 2.1963, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4093, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7385, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (12.4560 => 12.9258, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1232, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.81% (1.9433 => 1.9784, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6451, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.37% (0.4657 => 0.3615, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9713, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3511 => 0.3329, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.6576 => 0.6427, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.76% (33.2944 => 32.7075, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.54% (0.9108 => 0.8968, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0107) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1132, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9578, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9539, std. dev.: 0.0650) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (0.8342 => 0.8201, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2363, std. dev.: 0.0073) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1924, std. dev.: 0.0388) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8727, std. dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 13:03:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 15:03:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615200317.993952A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1135?compare_to=1132&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1135, Order: 158533, Start Time: 2012-06-15 19:04:09, End Time: 2012-06-15 20:04:40 To: 1132, Order: 158525, Start Time: 2012-06-15 17:37:22, End Time: 2012-06-15 18:37:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.09% (10.5507 => 10.6662, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.88% (10.3673 => 10.6662, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.97% (5.3526 => 5.4578, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (10.4361 => 10.5764, std. dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.04% (22.1758 => 21.7234, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (2.0665 => 2.0440, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 14:16:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 16:16:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615211610.6C1852A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1136?compare_to=1134&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1136, Order: 158535, Start Time: 2012-06-15 20:20:58, End Time: 2012-06-15 21:17:33 To: 1134, Order: 158533, Start Time: 2012-06-15 18:57:38, End Time: 2012-06-15 19:54:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (771 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4328 => 0.4487, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.6959 => 0.7211, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1078, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9199 => 0.9511, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.30% (1.3693 => 1.4145, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.27% (1.3245 => 1.3678, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 3.13% (16.6129 => 17.1328, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.06% (2.1791 => 2.2458, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4062 => 0.4183, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.7710 => 0.7938, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2012, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.69% (0.3899 => 0.4004, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.69% (1.2193 => 1.2521, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (3.8646 => 3.9684, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.1364 => 1.1645, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.2842 => 13.6061, std. dev.: 0.0121) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9708, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.27% (0.5818 => 0.5950, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2292 => 1.2568, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.3813 => 1.4116, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.18% (1.4563 => 1.4880, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.7460 => 0.7622, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (1.9828 => 2.0216, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 1.91% (0.5748 => 0.5858, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.86% (0.7061 => 0.7192, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0547, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7178, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1482, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2896, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4485, std. dev.: 0.0224) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6454, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std. dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1901, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1355, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5928 => 4.6466, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.41% (0.4657 => 0.3567, std. dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9633, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3511 => 0.3329, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3578 => 0.3439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.31% (0.6576 => 0.6424, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.82% (33.2944 => 32.6898, std. dev.: 0.0318) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.87% (2.5089 => 2.4117, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6044, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1240, std. dev.: 0.0134) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6973, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9736, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (0.8342 => 0.8200, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1916, std. dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0210) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2536, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8488, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 14:30:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 16:30:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615213007.8F8BF2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1137?compare_to=1135&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1137, Order: 158535, Start Time: 2012-06-15 20:30:56, End Time: 2012-06-15 21:31:30 To: 1135, Order: 158533, Start Time: 2012-06-15 19:04:09, End Time: 2012-06-15 20:04:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.89% (10.3673 => 10.6674, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.93% (5.3526 => 5.4560, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (10.4361 => 10.5748, std. dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.11% (22.1758 => 21.7084, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (2.0665 => 2.0451, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 15:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 17:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120615223250.61B862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1138?compare_to=1133&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1138, Order: 158535, Start Time: 2012-06-15 20:18:54, End Time: 2012-06-15 22:34:13 To: 1133, Order: 158525, Start Time: 2012-06-15 17:37:14, End Time: 2012-06-15 19:52:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Unchanged Tests: 893 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3914 => 0.4075, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 7.46% (0.3792 => 0.4075, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0034) Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 15:39:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 17:39:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120615223916.0B3DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1139?compare_to=1136&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1139, Order: 158543, Start Time: 2012-06-15 21:43:51, End Time: 2012-06-15 22:40:39 To: 1136, Order: 158535, Start Time: 2012-06-15 20:20:58, End Time: 2012-06-15 21:17:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (76 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (768 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.6466 => 4.7176, std. dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2749, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.87% (0.6959 => 0.7228, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (3.9660 => 4.1120, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4328 => 0.4487, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5265 => 0.5457, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (1.3245 => 1.3717, std. dev.: 0.0107) MultiSource/Applications/hbd/hbd: 3.55% (1.3693 => 1.4179, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.47% (0.7038 => 0.7282, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2526, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 3.30% (16.6129 => 17.1616, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.30% (0.5637 => 0.5823, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.04% (13.8202 => 14.2409, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8310 => 0.8560, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2193 => 1.2556, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9777, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.7710 => 0.7935, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.72% (0.3899 => 0.4005, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (13.2842 => 13.6303, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.56% (1.9270 => 1.9764, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.53% (1.3819 => 1.4169, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.7460 => 0.7648, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.43% (1.3813 => 1.4148, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4913, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2292 => 1.2579, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.5818 => 0.5953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.10% (0.7061 => 0.7209, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 2.09% (0.5748 => 0.5868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.98% (1.9828 => 2.0220, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.65% (14.8535 => 15.0987, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (3.6692 => 3.7258, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5028, std. dev.: 0.0197) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1274, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6532, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3094, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.04% (3.1889 => 3.2222, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.5188 => 1.5345, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.92% (1.2998 => 1.3898, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7166, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9191, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5163, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.97% (11.2619 => 11.5962, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.72% (4.5928 => 4.7176, std. dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1342, std. dev.: 0.0194) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.18% (0.4657 => 0.3717, std. dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0297, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.07% (0.3511 => 0.3333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.97% (0.3623 => 0.3479, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.63% (0.3578 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.25% (0.3940 => 0.3812, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.3914 => 0.3794, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.02% (0.6576 => 0.6443, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.61% (33.2944 => 32.7592, std. dev.: 0.0200) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.46% (0.9108 => 0.8975, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.8259 => 8.5691, std. dev.: 0.0263) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1133, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9586, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9145, std. dev.: 0.0709) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0224) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 15:56:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 17:56:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120615225659.1C5672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1140?compare_to=1137&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1140, Order: 158546, Start Time: 2012-06-15 21:57:46, End Time: 2012-06-15 22:58:20 To: 1137, Order: 158535, Start Time: 2012-06-15 20:30:56, End Time: 2012-06-15 21:31:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.33% (26.1264 => 26.7349, std. dev.: 0.0382) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (10.3673 => 10.7525, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (5.3526 => 5.4600, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (10.4361 => 10.5903, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.46% (26.0924 => 26.7349, std. dev.: 0.0382) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.92% (22.1758 => 21.7497, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 17:02:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 19:02:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616000208.68F6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1141?compare_to=1139&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1141, Order: 158567, Start Time: 2012-06-15 23:06:58, End Time: 2012-06-16 00:03:31 To: 1139, Order: 158543, Start Time: 2012-06-15 21:43:51, End Time: 2012-06-15 22:40:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (765 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2759, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.12% (0.2596 => 0.2703, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.6959 => 0.7233, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.9199 => 0.9548, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (3.9660 => 4.1153, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.3245 => 1.3727, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5265 => 0.5456, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.52% (1.3693 => 1.4175, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.50% (2.1791 => 2.2553, std. dev.: 0.0207) MultiSource/Benchmarks/nbench/nbench: 3.47% (1.0594 => 1.0962, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 3.45% (0.7038 => 0.7281, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.41% (16.6129 => 17.1787, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.16% (13.8202 => 14.2573, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8310 => 0.8570, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (3.8646 => 3.9823, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.00% (0.4062 => 0.4184, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1364 => 1.1699, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.76% (1.1061 => 1.1366, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (13.2842 => 13.6412, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.67% (0.3899 => 0.4003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.3819 => 1.4185, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.58% (1.9270 => 1.9768, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.7710 => 0.7909, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.55% (0.5577 => 0.5719, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.4563 => 1.4927, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.47% (1.2292 => 1.2596, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.43% (0.7460 => 0.7641, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 2.39% (0.5818 => 0.5957, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4141, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.14% (0.5748 => 0.5871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.04% (0.7061 => 0.7205, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (1.9828 => 2.0224, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.64% (16.2614 => 16.5282, std. dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0882, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (3.6692 => 3.7270, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.57% (0.7506 => 0.7624, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1498, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1284, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6566, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3139, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2259, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (1.5188 => 1.5361, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2745, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3941, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7301, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5873, std. dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1486, std. dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7151, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.82% (0.4657 => 0.3641, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0291, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.13% (0.3511 => 0.3331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3623 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.20% (0.3940 => 0.3814, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.82% (0.4003 => 0.3890, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.07% (0.6576 => 0.6440, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.61% (33.2944 => 32.7574, std. dev.: 0.0235) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3034, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5986, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.26% (9.3358 => 9.1245, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9051, std. dev.: 0.0486) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2375, std. dev.: 0.0170) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 17:23:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 19:23:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616002347.9C1C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1142?compare_to=1140&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1142, Order: 158570, Start Time: 2012-06-15 23:24:39, End Time: 2012-06-16 00:25:10 To: 1140, Order: 158546, Start Time: 2012-06-15 21:57:46, End Time: 2012-06-15 22:58:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.73% (10.3673 => 10.7543, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (5.3526 => 5.4614, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (10.4361 => 10.5853, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.43% (26.0924 => 26.7261, std. dev.: 0.0497) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.95% (22.1758 => 21.7432, std. dev.: 0.0237) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 18:14:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 20:14:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616011430.373352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1143?compare_to=1138&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1143, Order: 158564, Start Time: 2012-06-15 23:00:28, End Time: 2012-06-16 01:15:52 To: 1138, Order: 158535, Start Time: 2012-06-15 20:18:54, End Time: 2012-06-15 22:34:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (0 on baseline) Unchanged Tests: 893 (894 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.13% (2.7936 => 2.8252, std. dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 18:25:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 20:25:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616012500.B32552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1144?compare_to=1141&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1144, Order: 158578, Start Time: 2012-06-16 00:29:48, End Time: 2012-06-16 01:26:22 To: 1141, Order: 158567, Start Time: 2012-06-15 23:06:58, End Time: 2012-06-16 00:03:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2717, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4328 => 0.4499, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1048, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.37% (1.3693 => 1.4155, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4062 => 0.4193, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2472, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.12% (16.6129 => 17.1313, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.3899 => 0.4016, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.7038 => 0.7242, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2028, std. dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference-object: 2.70% (0.5818 => 0.5975, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2292 => 1.2616, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (3.8646 => 3.9650, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (1.9828 => 2.0338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.51% (0.5748 => 0.5892, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.7710 => 0.7902, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.44% (1.1061 => 1.1331, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6033, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.34% (0.7061 => 0.7226, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9708, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.89% (1.3813 => 1.4074, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7167, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0447, std. dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.09% (16.2614 => 16.4389, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2732, std. dev.: 0.0214) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.24% (2.0200 => 2.1864, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 7.77% (1.2998 => 1.4008, std. dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.81% (7.9275 => 8.1502, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7136, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.91% (0.4657 => 0.3683, std. dev.: 0.0189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.97% (22.5627 => 20.9899, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.53% (0.3511 => 0.3317, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.24% (0.8818 => 0.8532, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3650 => 0.3541, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -2.98% (0.3623 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: -2.76% (0.3663 => 0.3562, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.64% (33.2944 => 32.7499, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0124) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5984, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.18% (9.3358 => 9.1323, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9464, std. dev.: 0.0298) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6971, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5141, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4869, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2388, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 18:50:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 20:50:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616015043.E68AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1145?compare_to=1142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1145, Order: 158580, Start Time: 2012-06-16 00:51:31, End Time: 2012-06-16 01:52:05 To: 1142, Order: 158570, Start Time: 2012-06-15 23:24:39, End Time: 2012-06-16 00:25:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.05% (2.2780 => 2.3246, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -5.42% (10.7543 => 10.1713, std. dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.39% (5.3526 => 5.4271, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7226, std. dev.: 0.0299) SingleSource/Benchmarks/Misc/fbench: 2.09% (2.2771 => 2.3246, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.08% (22.1758 => 21.7147, std. dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (10.3673 => 10.1713, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (2.0665 => 2.0452, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 19:48:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 21:48:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616024801.475B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1146?compare_to=1144&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1146, Order: 158586, Start Time: 2012-06-16 01:52:53, End Time: 2012-06-16 02:49:24 To: 1144, Order: 158578, Start Time: 2012-06-16 00:29:48, End Time: 2012-06-16 01:26:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.65% (2.0176 => 2.2729, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.18% (0.4328 => 0.4509, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.71% (1.3693 => 1.4201, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.6959 => 0.7213, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.62% (0.4062 => 0.4209, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1045, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3245 => 1.3644, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.3899 => 0.4013, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3485 => 0.3585, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3580 => 0.3682, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7038 => 0.7234, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.68% (1.2292 => 1.2621, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2374, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0564, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (1.9828 => 2.0352, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.64% (13.8202 => 14.1854, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.4016 => 0.4117, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9611, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.46% (0.7710 => 0.7900, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 2.41% (0.5818 => 0.5958, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 2.23% (0.5748 => 0.5876, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.2842 => 13.5652, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.04% (1.9270 => 1.9663, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.04% (0.7061 => 0.7205, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4044, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.8698 => 0.8804, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0273, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7113, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 26.17% (1.8175 => 2.2931, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7264, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7150, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1233, std. dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.10% (0.4657 => 0.3721, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.45% (22.5627 => 20.8815, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.75% (0.3623 => 0.3487, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.62% (0.3650 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.47% (0.3578 => 0.3454, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3663 => 0.3538, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.99% (0.3914 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.54% (0.9108 => 0.8968, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.38% (33.2944 => 32.8360, std. dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (4.9865 => 4.9341, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5899, std. dev.: 0.0217) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9567, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -2.24% (9.3358 => 9.1263, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6963, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9910, std. dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0160) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2309, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 20:17:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 22:17:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616031731.B06FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1147?compare_to=1145&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1147, Order: 158590, Start Time: 2012-06-16 02:18:39, End Time: 2012-06-16 03:18:54 To: 1145, Order: 158580, Start Time: 2012-06-16 00:51:31, End Time: 2012-06-16 01:52:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 14 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 859 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.81% (0.8583 => 0.7312, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.17% (5.2683 => 4.7852, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.86% (2.9411 => 2.6804, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.32% (1.1253 => 1.0429, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.39% (54.2684 => 51.3447, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (5.4271 => 5.1372, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.30% (5.3334 => 5.1039, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.17% (6.6408 => 6.3640, std. dev.: 0.0231) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.31% (0.4882 => 0.4769, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.31% (21.7147 => 21.2121, std. dev.: 0.0219) MultiSource/Applications/JM/ldecod/ldecod: -1.94% (10.5402 => 10.3360, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (2.1819 => 2.1417, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.44% (7.0248 => 6.9235, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.28% (2.3246 => 2.2716, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7592, std. dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.48% (0.8651 => 0.7312, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.31% (5.2763 => 4.7852, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.78% (2.9384 => 2.6804, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.83% (1.1194 => 1.0429, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (5.3855 => 5.1039, std. dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3447, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.84% (6.6874 => 6.3640, std. dev.: 0.0231) MultiSource/Applications/ClamAV/clamscan: -4.35% (22.1758 => 21.2121, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.02% (5.3526 => 5.1372, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.75% (2.2022 => 2.1417, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.85% (7.0540 => 6.9235, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.23% (1.7609 => 1.7393, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.10% (10.3673 => 10.2536, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.08% (1.5603 => 1.5434, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (7.9617 => 7.8784, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 20:56:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 22:56:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616035625.376492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1148?compare_to=1143&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1148, Order: 158585, Start Time: 2012-06-16 01:42:16, End Time: 2012-06-16 03:57:48 To: 1143, Order: 158564, Start Time: 2012-06-15 23:00:28, End Time: 2012-06-16 01:15:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (2 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 891 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.2285 => 0.2411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.22% (0.2184 => 0.2298, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.64% (2.4546 => 2.3898, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 13.74% (0.3792 => 0.4313, std. dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.29% (0.2122 => 0.2298, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.50% (2.4764 => 2.3898, std. dev.: 0.0009) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 21:11:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 23:11:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616041103.67ADF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1149?compare_to=1146&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1149, Order: 158591, Start Time: 2012-06-16 03:15:52, End Time: 2012-06-16 04:12:26 To: 1146, Order: 158586, Start Time: 2012-06-16 01:52:53, End Time: 2012-06-16 02:49:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (82 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (772 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.23% (1.4131 => 1.3957, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2712, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4328 => 0.4525, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.6959 => 0.7232, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.4062 => 0.4221, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 3.88% (0.2781 => 0.2889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.76% (0.5818 => 0.6037, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.72% (1.3693 => 1.4203, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.67% (0.9199 => 0.9537, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.64% (0.3022 => 0.3132, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1094, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: 3.55% (0.5748 => 0.5952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.2937 => 0.3041, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.3899 => 0.4034, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 3.34% (0.7061 => 0.7297, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.18% (16.6129 => 17.1405, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (1.9828 => 2.0454, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3580 => 0.3693, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.13% (1.2292 => 1.2677, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3485 => 0.3592, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2455, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3489 => 0.3594, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.98% (0.3453 => 0.3556, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.4016 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.7710 => 0.7930, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (0.7038 => 0.7233, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3868 => 0.3975, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.75% (3.8646 => 3.9710, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.71% (0.4390 => 0.4509, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1948, std. dev.: 0.0174) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6031, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9702, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.7460 => 0.7621, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.4563 => 1.4857, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (0.8698 => 0.8810, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0398, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7091, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std. dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.13% (0.9996 => 1.0809, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.38% (1.2998 => 1.3957, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7293, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5869, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1451, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.87% (0.4657 => 0.3778, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8742, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.36% (0.6576 => 0.6421, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (4.9865 => 4.9357, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5976, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9561, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1202, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9432, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6976, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4882, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2373, std. dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 21:44:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 15 Jun 2012 23:44:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616044432.3AD8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1150?compare_to=1147&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1150, Order: 158591, Start Time: 2012-06-16 03:45:22, End Time: 2012-06-16 04:45:55 To: 1147, Order: 158590, Start Time: 2012-06-16 02:18:39, End Time: 2012-06-16 03:18:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 1 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (855 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (10.2536 => 10.1484, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7645, std. dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.51% (1.3045 => 1.3242, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.92% (0.8651 => 0.7274, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.45% (5.2763 => 4.7777, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.81% (2.9384 => 2.6795, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (1.1194 => 1.0452, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.38% (5.3855 => 5.0959, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3422, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.63% (6.6874 => 6.3776, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.21% (22.1758 => 21.2428, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.16% (5.3526 => 5.1300, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3817 => 0.3669, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.71% (2.2022 => 2.1425, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (10.3673 => 10.1484, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.81% (7.0540 => 6.9261, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (1.7609 => 1.7338, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (7.9617 => 7.8818, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 22:34:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 00:34:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616053405.0DD262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1151?compare_to=1149&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1151, Order: 158593, Start Time: 2012-06-16 04:38:58, End Time: 2012-06-16 05:35:28 To: 1149, Order: 158591, Start Time: 2012-06-16 03:15:52, End Time: 2012-06-16 04:12:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.40% (0.7297 => 0.7195, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.03% (2.0176 => 2.2804, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4328 => 0.4502, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.70% (1.3693 => 1.4199, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 3.32% (0.4062 => 0.4197, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.6959 => 0.7190, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0975, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9199 => 0.9499, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3648, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7038 => 0.7241, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2387, std. dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2292 => 1.2627, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.65% (1.9828 => 2.0353, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.50% (16.6129 => 17.0285, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.45% (0.5637 => 0.5775, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.42% (13.8202 => 14.1550, std. dev.: 0.0158) SingleSource/UnitTests/ObjC++/property-reference-object: 2.27% (0.5818 => 0.5950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2469, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9498, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.19% (1.1364 => 1.1613, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.2842 => 13.5646, std. dev.: 0.0127) SingleSource/UnitTests/ObjC++/Hello: 1.98% (0.5748 => 0.5862, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9651, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 1.90% (0.7061 => 0.7195, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4006, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0302, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2616, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.21% (1.2998 => 1.4065, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7247, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5866, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7146, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1275, std. dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.89% (0.4657 => 0.3684, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.95% (22.5627 => 20.7691, std. dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3578 => 0.3427, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.50% (0.6576 => 0.6346, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.8818 => 0.8534, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.95% (0.9108 => 0.8930, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.67% (33.2944 => 32.7386, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.49% (4.9865 => 4.9120, std. dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0135) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1164, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9533, std. dev.: 0.0512) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2360, std. dev.: 0.0223) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 23:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 01:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616061120.7E67E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1152?compare_to=1150&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1152, Order: 158594, Start Time: 2012-06-16 05:12:33, End Time: 2012-06-16 06:12:43 To: 1150, Order: 158591, Start Time: 2012-06-16 03:45:22, End Time: 2012-06-16 04:45:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (1 on baseline) Performance Improvements: 4 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 868 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.20% (10.3506 => 10.4753, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.73% (0.5953 => 0.5850, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7327 => 0.7202, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.70% (0.6052 => 0.5949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.0641 => 2.0401, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7500, std. dev.: 0.0400) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.16% (0.8651 => 0.7253, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.38% (5.2763 => 4.7815, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.71% (2.9384 => 2.6824, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.56% (1.1194 => 1.0460, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2824, std. dev.: 0.0213) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (5.3855 => 5.1089, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -4.52% (22.1758 => 21.1745, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.32% (6.6874 => 6.3985, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.69% (5.3526 => 5.1551, std. dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (2.2022 => 2.1445, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -2.46% (10.3673 => 10.1121, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.88% (7.0540 => 6.9215, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7326 => 0.7202, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.51% (7.9617 => 7.8413, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.28% (2.0665 => 2.0401, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.23% (1.7609 => 1.7392, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.21% (8.1363 => 8.0376, std. dev.: 0.0094) MultiSource/Applications/hbd/hbd: -1.17% (1.5603 => 1.5420, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 23:38:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 01:38:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616063808.42B3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1153?compare_to=1148&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1153, Order: 158592, Start Time: 2012-06-16 04:24:13, End Time: 2012-06-16 06:39:27 To: 1148, Order: 158585, Start Time: 2012-06-16 01:42:16, End Time: 2012-06-16 03:57:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 5 (4 on baseline) Unchanged Tests: 889 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.14% (0.4313 => 0.3703, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.49% (0.4273 => 0.4124, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -1.26% (5.5836 => 5.5133, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -1.03% (1.6093 => 1.5928, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.02% (1.4298 => 1.4152, std. dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.48% (2.4764 => 2.3903, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.4253 => 0.4124, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.07% (4.6926 => 4.6422, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.04% (1.9966 => 1.9759, std. dev.: 0.0027) Report Time: 3.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 15 23:57:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 01:57:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616065706.22FB42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1154?compare_to=1151&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1154, Order: 158594, Start Time: 2012-06-16 06:01:55, End Time: 2012-06-16 06:58:29 To: 1151, Order: 158593, Start Time: 2012-06-16 04:38:58, End Time: 2012-06-16 05:35:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2761, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.86% (0.4328 => 0.4495, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 3.32% (1.3693 => 1.4147, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9199 => 0.9492, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4062 => 0.4187, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.78% (2.1791 => 2.2396, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.77% (0.3899 => 0.4007, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7038 => 0.7230, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2292 => 1.2601, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.41% (13.8202 => 14.1534, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 2.34% (16.6129 => 17.0018, std. dev.: 0.0799) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (1.9828 => 2.0292, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9496, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.2193 => 1.2453, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 2.06% (0.5818 => 0.5938, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 1.97% (0.5748 => 0.5861, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5358, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9619, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.78% (1.4563 => 1.4822, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 1.70% (0.7061 => 0.7181, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.3819 => 1.4029, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0050, std. dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2564, std. dev.: 0.0506) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0200) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7361, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7138, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1339, std. dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.74% (0.4657 => 0.3691, std. dev.: 0.0239) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.98% (22.5627 => 20.7617, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.56% (0.6576 => 0.6342, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.8818 => 0.8512, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.02% (0.9108 => 0.8924, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.76% (33.2944 => 32.7094, std. dev.: 0.0249) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (4.9865 => 4.9060, std. dev.: 0.0229) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2063, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5923, std. dev.: 0.0159) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.23% (9.3358 => 9.1273, std. dev.: 0.0089) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9022, std. dev.: 0.0550) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6969, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std. dev.: 0.0218) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 00:40:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 02:40:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616074024.7F8342A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1155?compare_to=1152&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1155, Order: 158596, Start Time: 2012-06-16 06:39:13, End Time: 2012-06-16 07:41:47 To: 1152, Order: 158594, Start Time: 2012-06-16 05:12:33, End Time: 2012-06-16 06:12:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7249, std. dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.91% (0.8651 => 0.7275, std. dev.: 0.0353) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.43% (5.2763 => 4.7787, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.88% (2.9384 => 2.6774, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.86% (1.1194 => 1.0426, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.37% (54.1659 => 51.2593, std. dev.: 0.9701) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (5.3855 => 5.1130, std. dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: -4.72% (22.1758 => 21.1297, std. dev.: 0.0338) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.40% (6.6874 => 6.3932, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.56% (5.3526 => 5.1623, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.67% (2.2022 => 2.1433, std. dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: -2.49% (10.3673 => 10.1096, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.92% (7.0540 => 6.9189, std. dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.58% (7.9617 => 7.8357, std. dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.30% (2.0665 => 2.0397, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.23% (8.1363 => 8.0361, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7406, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: -1.13% (1.5603 => 1.5427, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 01:24:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 03:24:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616082446.E219C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1156?compare_to=1154&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1156, Order: 158596, Start Time: 2012-06-16 07:29:21, End Time: 2012-06-16 08:26:09 To: 1154, Order: 158594, Start Time: 2012-06-16 06:01:55, End Time: 2012-06-16 06:58:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2770, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.86% (0.4328 => 0.4495, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.39% (1.3693 => 1.4157, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0936, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.4062 => 0.4189, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.3899 => 0.4014, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.92% (2.1791 => 2.2428, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.57% (16.6129 => 17.0398, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7038 => 0.7218, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (1.9828 => 2.0335, std. dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1698, std. dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 2.47% (1.2292 => 1.2596, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9516, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2193 => 1.2466, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 2.11% (0.5818 => 0.5941, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.03% (1.1061 => 1.1286, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 1.93% (0.5748 => 0.5859, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9638, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.4563 => 1.4836, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7061 => 0.7186, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.27% (1.3819 => 1.3995, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0048, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.24% (1.8175 => 2.2762, std. dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3959, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.81% (7.4271 => 7.7098, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5836, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1423, std. dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7156, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9530, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.97% (22.5627 => 20.7644, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.19% (0.6576 => 0.6366, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.00% (0.9108 => 0.8926, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.66% (33.2944 => 32.7421, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.48% (4.9865 => 4.9126, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2063, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5947, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1137, std. dev.: 0.0173) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0069, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2582, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2372, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 02:26:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 04:26:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616092607.D75F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1157?compare_to=1153&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1157, Order: 158596, Start Time: 2012-06-16 07:09:51, End Time: 2012-06-16 09:27:31 To: 1153, Order: 158592, Start Time: 2012-06-16 04:24:13, End Time: 2012-06-16 06:39:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Performance Improvements: 0 (6 on baseline) Unchanged Tests: 893 (887 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 29.71% (0.3703 => 0.4803, std. dev.: 0.0244) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.66% (0.3792 => 0.4803, std. dev.: 0.0244) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.61% (0.4253 => 0.4142, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: -1.38% (0.7875 => 0.7766, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.36% (4.6926 => 4.6289, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.34% (1.9966 => 1.9698, std. dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (2.7292 => 2.6941, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.22% (1.9694 => 1.9453, std. dev.: 0.0025) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 03:56:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 05:56:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616105659.5841A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1158?compare_to=1156&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1158, Order: 158598, Start Time: 2012-06-16 09:59:36, End Time: 2012-06-16 10:58:22 To: 1156, Order: 158596, Start Time: 2012-06-16 07:29:21, End Time: 2012-06-16 08:26:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (783 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.79% (2.0176 => 2.2756, std. dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4328 => 0.4501, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.4062 => 0.4218, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.41% (1.3693 => 1.4160, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.9199 => 0.9493, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (3.9660 => 4.0915, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.84% (2.1791 => 2.2409, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.82% (0.3899 => 0.4009, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0594 => 1.0882, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.7710 => 0.7917, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (0.7038 => 0.7226, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (1.9828 => 2.0349, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0326, std. dev.: 0.0228) MultiSource/Applications/SPASS/SPASS: 2.52% (13.8202 => 14.1680, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 2.51% (1.2292 => 1.2600, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.33% (1.1061 => 1.1319, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.29% (3.8646 => 3.9530, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.2193 => 1.2453, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5382, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.4563 => 1.4835, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9623, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.3819 => 1.4025, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.3813 => 1.4014, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0047, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0425) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1889, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3924, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7376, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7164, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1349, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.73% (22.5627 => 20.8192, std. dev.: 0.3369) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3578 => 0.3425, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.8818 => 0.8515, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.12% (0.6576 => 0.6371, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.98% (0.9108 => 0.8928, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.40% (4.9865 => 4.9168, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2063, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0126) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5982, std. dev.: 0.0158) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1098, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8822, std. dev.: 0.0684) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6986, std. dev.: 0.1264) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2556, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 03:59:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 05:59:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616105918.AB6BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1159?compare_to=1155&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1159, Order: 158598, Start Time: 2012-06-16 09:59:57, End Time: 2012-06-16 11:00:40 To: 1155, Order: 158596, Start Time: 2012-06-16 06:39:13, End Time: 2012-06-16 07:41:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (852 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.61% (2.2800 => 2.3851, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (19.6453 => 19.9322, std. dev.: 0.0961) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.74% (2.2771 => 2.3851, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7239, std. dev.: 0.0320) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.91% (0.8651 => 0.7275, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.41% (5.2763 => 4.7800, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.89% (2.9384 => 2.6772, std. dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (1.1194 => 1.0435, std. dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2362, std. dev.: 0.0379) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.08% (5.3855 => 5.1119, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -4.58% (22.1758 => 21.1599, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3901, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.54% (5.3526 => 5.1629, std. dev.: 0.0287) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.69% (2.2022 => 2.1429, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.49% (10.3673 => 10.1096, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.28% (0.4879 => 0.4768, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.70% (7.0540 => 6.9340, std. dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: -1.68% (0.7326 => 0.7203, std. dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (7.9617 => 7.8334, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.25% (2.0665 => 2.0407, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.23% (8.1363 => 8.0362, std. dev.: 0.0111) MultiSource/Applications/hbd/hbd: -1.13% (1.5603 => 1.5427, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.10% (1.7609 => 1.7415, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 05:21:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 07:21:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616122133.31F682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1160?compare_to=1158&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1160, Order: 158600, Start Time: 2012-06-16 11:26:08, End Time: 2012-06-16 12:22:54 To: 1158, Order: 158598, Start Time: 2012-06-16 09:59:36, End Time: 2012-06-16 10:58:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.78% (2.0176 => 2.2754, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.88% (0.4328 => 0.4496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.51% (0.6959 => 0.7203, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4062 => 0.4202, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.32% (1.3693 => 1.4147, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9199 => 0.9489, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0908, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.75% (2.1791 => 2.2390, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0594 => 1.0884, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.72% (0.3899 => 0.4005, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.7710 => 0.7912, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (1.9828 => 2.0325, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.2292 => 1.2598, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (3.8646 => 3.9591, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0185, std. dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.35% (13.8202 => 14.1455, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (13.2842 => 13.5592, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: 2.02% (0.5748 => 0.5864, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.01% (0.5818 => 0.5935, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.86% (1.9270 => 1.9628, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.7061 => 0.7184, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3986, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.34% (1.8175 => 2.2780, std. dev.: 0.0214) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 6.72% (1.2998 => 1.3872, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.88% (7.9275 => 8.1555, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.72% (4.5928 => 4.7176, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2142, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 1.03% (1.9290 => 1.9489, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.95% (22.5627 => 20.7680, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.44% (0.3623 => 0.3462, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3578 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.55% (0.8818 => 0.8505, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.47% (0.6576 => 0.6348, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.98% (0.9108 => 0.8928, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.68% (33.2944 => 32.7336, std. dev.: 0.0284) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.46% (4.9865 => 4.9136, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2046, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.87% (2.5089 => 2.4117, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5978, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9562, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1550, std. dev.: 0.0266) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6994, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9741, std. dev.: 0.0351) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2562, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2354, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 05:26:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 07:26:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616122652.A72362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1161?compare_to=1159&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1161, Order: 158600, Start Time: 2012-06-16 11:28:00, End Time: 2012-06-16 12:28:15 To: 1159, Order: 158598, Start Time: 2012-06-16 09:59:57, End Time: 2012-06-16 11:00:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -4.25% (2.3851 => 2.2838, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.51% (26.0924 => 26.7486, std. dev.: 0.0291) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.88% (0.8651 => 0.7277, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.37% (5.2763 => 4.7820, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.96% (2.9384 => 2.6750, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (1.1194 => 1.0431, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2687, std. dev.: 0.0323) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.07% (5.3855 => 5.1124, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.73% (22.1758 => 21.1262, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.47% (6.6874 => 6.3885, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.56% (5.3526 => 5.1621, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.77% (2.2022 => 2.1413, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (10.3673 => 10.1086, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.36% (0.4879 => 0.4764, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.89% (7.0540 => 6.9210, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: -1.77% (0.7326 => 0.7196, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.59% (7.9617 => 7.8355, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.30% (8.1363 => 8.0305, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.18% (1.7609 => 1.7402, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.15% (1.5603 => 1.5423, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 05:36:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 07:36:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616123617.537FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1162?compare_to=1157&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1162, Order: 158599, Start Time: 2012-06-16 10:21:37, End Time: 2012-06-16 12:37:40 To: 1157, Order: 158596, Start Time: 2012-06-16 07:09:51, End Time: 2012-06-16 09:27:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (7 on baseline) Unchanged Tests: 893 (885 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 8.32% (0.2224 => 0.2409, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 32.57% (0.3792 => 0.5027, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.45% (0.7875 => 0.7761, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.40% (1.9694 => 1.9419, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.37% (2.7292 => 2.6918, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.35% (1.9966 => 1.9696, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.35% (4.6926 => 4.6292, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.21% (1.4269 => 1.4096, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.05% (11.6398 => 11.5179, std. dev.: 0.0082) Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 06:45:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 08:45:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616134506.449872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1163?compare_to=1160&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1163, Order: 158601, Start Time: 2012-06-16 12:49:46, End Time: 2012-06-16 13:46:29 To: 1160, Order: 158600, Start Time: 2012-06-16 11:26:08, End Time: 2012-06-16 12:22:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.30% (1.3872 => 1.4053, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4328 => 0.4504, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.6959 => 0.7201, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 3.40% (1.3693 => 1.4158, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9199 => 0.9494, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0926, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4062 => 0.4190, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.82% (0.3899 => 0.4009, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2392, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.60% (0.7038 => 0.7221, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.58% (1.2292 => 1.2609, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 2.49% (16.6129 => 17.0259, std. dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1563, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (1.9828 => 2.0300, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (3.8646 => 3.9527, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.21% (0.7061 => 0.7217, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2193 => 1.2460, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.10% (1.1061 => 1.1293, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 2.01% (0.5818 => 0.5935, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (1.4563 => 1.4853, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.92% (1.9270 => 1.9640, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5340, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: 1.88% (0.5748 => 0.5856, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (1.3813 => 1.3982, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7415, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1384, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7146, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.27% (9.0760 => 9.1912, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.04% (0.4657 => 0.3817, std. dev.: 0.0319) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.87% (22.5627 => 20.7875, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.31% (0.3646 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.54% (0.8818 => 0.8506, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.50% (0.6576 => 0.6346, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.04% (0.9108 => 0.8922, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.75% (33.2944 => 32.7119, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.51% (4.9865 => 4.9111, std. dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2057, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.43% (1.3780 => 1.3032, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5877, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1132, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9583, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9423, std. dev.: 0.0760) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6988, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std. dev.: 0.0190) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 06:53:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 08:53:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616135348.2ABF32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1164?compare_to=1161&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1164, Order: 158601, Start Time: 2012-06-16 12:54:55, End Time: 2012-06-16 13:55:12 To: 1161, Order: 158600, Start Time: 2012-06-16 11:28:00, End Time: 2012-06-16 12:28:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (853 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7680, std. dev.: 0.0200) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.84% (0.8651 => 0.7281, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.41% (5.2763 => 4.7798, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.91% (2.9384 => 2.6766, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.84% (1.1194 => 1.0428, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.36% (54.1659 => 51.2612, std. dev.: 0.0246) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (5.3855 => 5.1113, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -4.74% (22.1758 => 21.1257, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.49% (6.6874 => 6.3871, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.59% (5.3526 => 5.1607, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.77% (2.2022 => 2.1411, std. dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -2.54% (10.3673 => 10.1044, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.40% (0.4879 => 0.4762, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.88% (7.0540 => 6.9211, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7326 => 0.7201, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (7.9617 => 7.8337, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.25% (8.1363 => 8.0348, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (2.0665 => 2.0410, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: -1.20% (1.5603 => 1.5415, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7406, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 08:18:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 10:18:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616151824.328F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1165?compare_to=1162&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1165, Order: 158601, Start Time: 2012-06-16 13:04:25, End Time: 2012-06-16 15:19:48 To: 1162, Order: 158599, Start Time: 2012-06-16 10:21:37, End Time: 2012-06-16 12:37:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Performance Improvements: 2 (10 on baseline) Unchanged Tests: 892 (882 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.97% (0.5027 => 0.4174, std. dev.: 0.0181) SingleSource/UnitTests/Vector/constpool: -1.32% (2.4243 => 2.3923, std. dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.63% (2.8036 => 2.8493, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3923, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.4253 => 0.4140, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.42% (1.9966 => 1.9683, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7171 => 0.7071, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: -1.37% (0.7875 => 0.7767, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.36% (4.6926 => 4.6287, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.36% (1.9694 => 1.9426, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (2.7292 => 2.6927, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.10% (11.6398 => 11.5115, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.06% (1.4269 => 1.4118, std. dev.: 0.0006) Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 10:05:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 12:05:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616170508.128AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1166?compare_to=1163&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1166, Order: 158602, Start Time: 2012-06-16 16:09:53, End Time: 2012-06-16 17:06:31 To: 1163, Order: 158601, Start Time: 2012-06-16 12:49:46, End Time: 2012-06-16 13:46:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2767, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4328 => 0.4501, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.33% (1.3693 => 1.4149, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0954, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.4062 => 0.4189, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.3245 => 1.3633, std. dev.: 0.0099) MultiSource/Applications/siod/siod: 2.73% (2.1791 => 2.2385, std. dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.72% (0.3899 => 0.4005, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.50% (1.2292 => 1.2599, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (1.9828 => 2.0317, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.41% (16.6129 => 17.0137, std. dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1465, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9478, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 2.13% (0.5818 => 0.5942, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.09% (1.1061 => 1.1292, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 1.91% (0.5748 => 0.5858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5364, std. dev.: 0.0105) MultiSource/Applications/treecc/treecc: 1.89% (1.9270 => 1.9635, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4824, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.7061 => 0.7184, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3988, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0053, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.19% (1.8175 => 2.2754, std. dev.: 0.0404) SingleSource/Benchmarks/Misc/mandel-2: 8.63% (1.2998 => 1.4120, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.09% (0.9996 => 1.0805, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.88% (7.4271 => 7.7151, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9191, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1429, std. dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7129, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9520, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.88% (22.5627 => 20.7846, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3578 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.06% (0.3789 => 0.3635, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.3914 => 0.3766, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.6576 => 0.6340, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.52% (0.8818 => 0.8508, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.99% (0.9108 => 0.8927, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.71% (33.2944 => 32.7235, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.50% (4.9865 => 4.9116, std. dev.: 0.0180) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2056, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std. dev.: 0.0212) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1109, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5131, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9939, std. dev.: 0.0241) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3452, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2402, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 10:08:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 12:08:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616170854.8DA802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1167?compare_to=1164&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1167, Order: 158602, Start Time: 2012-06-16 16:09:56, End Time: 2012-06-16 17:10:15 To: 1164, Order: 158601, Start Time: 2012-06-16 12:54:55, End Time: 2012-06-16 13:55:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7601, std. dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.87% (0.8651 => 0.7278, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.40% (5.2763 => 4.7803, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.78% (2.9384 => 2.6805, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.86% (1.1194 => 1.0426, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.37% (54.1659 => 51.2549, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (5.3855 => 5.1107, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -4.71% (22.1758 => 21.1317, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.47% (6.6874 => 6.3887, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.58% (5.3526 => 5.1610, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.70% (2.2022 => 2.1428, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (10.3673 => 10.1114, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.40% (0.4879 => 0.4762, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.90% (7.0540 => 6.9201, std. dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7326 => 0.7202, std. dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.57% (7.9617 => 7.8365, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.16% (8.1363 => 8.0419, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: -1.15% (1.5603 => 1.5423, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7407, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 11:23:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 13:23:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616182354.32CEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1168?compare_to=1165&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1168, Order: 158602, Start Time: 2012-06-16 16:09:48, End Time: 2012-06-16 18:25:16 To: 1165, Order: 158601, Start Time: 2012-06-16 13:04:25, End Time: 2012-06-16 15:19:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Performance Improvements: 0 (10 on baseline) Unchanged Tests: 893 (883 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.2111 => 0.2412, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.36% (0.2122 => 0.2257, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.42% (2.4764 => 2.3669, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.61% (0.4253 => 0.4142, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.48% (1.9966 => 1.9671, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.41% (4.6926 => 4.6264, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: -1.41% (0.7875 => 0.7764, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -1.41% (0.7171 => 0.7070, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.35% (1.9694 => 1.9428, std. dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.33% (2.7292 => 2.6930, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.12% (11.6398 => 11.5097, std. dev.: 0.0136) MultiSource/Applications/lua/lua: -1.00% (1.4269 => 1.4126, std. dev.: 0.0031) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 11:51:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 13:51:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616185112.BE1C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1169?compare_to=1166&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1169, Order: 158603, Start Time: 2012-06-16 17:55:57, End Time: 2012-06-16 18:52:35 To: 1166, Order: 158602, Start Time: 2012-06-16 16:09:53, End Time: 2012-06-16 17:06:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2770, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.4328 => 0.4500, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.35% (1.3693 => 1.4152, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0959, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9199 => 0.9489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4062 => 0.4190, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.3899 => 0.4013, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.91% (0.3580 => 0.3684, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0594 => 1.0884, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2374, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7038 => 0.7224, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.42% (1.2292 => 1.2590, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.42% (1.9828 => 2.0307, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.40% (16.6129 => 17.0123, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1466, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9493, std. dev.: 0.0050) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.03% (0.5818 => 0.5936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.95% (0.5748 => 0.5860, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (0.7710 => 0.7860, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.94% (1.9270 => 1.9644, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5365, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 1.73% (0.7061 => 0.7183, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4031, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std. dev.: 0.0411) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.74% (1.2998 => 1.4004, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7401, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.91% (7.9275 => 8.1585, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5858, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7165, std. dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.91% (22.5627 => 20.7775, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.45% (0.3663 => 0.3500, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: -4.42% (0.3646 => 0.3485, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.6576 => 0.6340, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.8818 => 0.8513, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.97% (0.9108 => 0.8929, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.74% (33.2944 => 32.7166, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.51% (4.9865 => 4.9111, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2056, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6124, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1196, std. dev.: 0.0194) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9576, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9274, std. dev.: 0.0459) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2507, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2377, std. dev.: 0.0189) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 11:57:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 13:57:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616185717.EEABD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1170?compare_to=1167&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1170, Order: 158603, Start Time: 2012-06-16 17:58:20, End Time: 2012-06-16 18:58:42 To: 1167, Order: 158602, Start Time: 2012-06-16 16:09:56, End Time: 2012-06-16 17:10:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (853 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7579, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.89% (0.8651 => 0.7276, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.44% (5.2763 => 4.7783, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.87% (2.9384 => 2.6777, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.83% (1.1194 => 1.0429, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.34% (54.1659 => 51.2754, std. dev.: 0.0256) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.12% (5.3855 => 5.1096, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.55% (22.1758 => 21.1666, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.51% (6.6874 => 6.3857, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.64% (5.3526 => 5.1578, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.72% (2.2022 => 2.1423, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (10.3673 => 10.1078, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.28% (0.4879 => 0.4768, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.98% (7.0540 => 6.9145, std. dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (7.9617 => 7.8326, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.35% (2.0665 => 2.0387, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.29% (8.1363 => 8.0315, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (1.7609 => 1.7396, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.15% (1.5603 => 1.5424, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -1.01% (21.9371 => 21.7152, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 13:14:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 15:14:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616201442.3DF862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1171?compare_to=1169&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1171, Order: 158604, Start Time: 2012-06-16 19:19:08, End Time: 2012-06-16 20:16:05 To: 1169, Order: 158603, Start Time: 2012-06-16 17:55:57, End Time: 2012-06-16 18:52:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (766 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.45% (0.3673 => 0.3873, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2895, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.74% (0.4328 => 0.4533, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.17% (1.3693 => 1.4264, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.79% (0.4062 => 0.4216, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 3.67% (0.2781 => 0.2883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3022 => 0.3130, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1048, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3899 => 0.4029, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3580 => 0.3695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (1.9828 => 2.0461, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.12% (1.2292 => 1.2676, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3489 => 0.3597, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3485 => 0.3592, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.7038 => 0.7245, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2430, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 2.82% (16.6129 => 17.0813, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.4016 => 0.4128, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.7710 => 0.7916, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1872, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.64% (0.8310 => 0.8529, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4390 => 0.4497, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.38% (1.1061 => 1.1324, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.2193 => 1.2482, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8646 => 3.9559, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5844, std. dev.: 0.0223) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.18% (1.4563 => 1.4880, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.17% (1.9270 => 1.9689, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 2.03% (0.5818 => 0.5936, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 1.66% (0.7061 => 0.7178, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4004, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.8698 => 0.8808, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0387, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7077, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6415, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.58% (1.8175 => 2.2824, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.60% (2.0200 => 2.1937, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.01% (0.9996 => 1.0797, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3932, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7117, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8321, std. dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.95% (7.9275 => 8.1615, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.74% (4.5928 => 4.7186, std. dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std. dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.57% (22.5627 => 20.8539, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.80% (0.6576 => 0.6326, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.37% (0.3623 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.28% (0.3601 => 0.3483, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.24% (0.8818 => 0.8532, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -3.16% (0.3578 => 0.3465, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.15% (0.3650 => 0.3535, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.84% (0.3940 => 0.3828, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.66% (0.3914 => 0.3810, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (4.9865 => 4.9303, std. dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: -1.10% (33.2944 => 32.9284, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5803, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9603, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9327, std. dev.: 0.0907) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6987, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.55% (9.3358 => 9.1910, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2311, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2549, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 13:24:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 15:24:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616202400.0F4C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1172?compare_to=1170&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1172, Order: 158604, Start Time: 2012-06-16 19:25:13, End Time: 2012-06-16 20:25:24 To: 1170, Order: 158603, Start Time: 2012-06-16 17:58:20, End Time: 2012-06-16 18:58:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (851 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.63% (10.1078 => 10.4752, std. dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.04% (10.3673 => 10.4752, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7419, std. dev.: 0.0343) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3192, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.93% (0.8651 => 0.7273, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.51% (5.2763 => 4.7746, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.68% (2.9384 => 2.6833, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (1.1194 => 1.0444, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2345, std. dev.: 0.0439) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (5.3855 => 5.1101, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -4.74% (22.1758 => 21.1238, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.54% (6.6874 => 6.3838, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.56% (5.3526 => 5.1620, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.52% (2.2022 => 2.1466, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.15% (0.4879 => 0.4774, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.64% (1.7609 => 1.7320, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.64% (7.0540 => 6.9383, std. dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (7.9617 => 7.8326, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.28% (2.0665 => 2.0400, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.18% (1.5603 => 1.5419, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -1.07% (21.9371 => 21.7021, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.06% (8.1363 => 8.0498, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.06% (9.4845 => 9.3838, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 14:05:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 16:05:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616210544.299322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1173?compare_to=1168&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1173, Order: 158604, Start Time: 2012-06-16 18:51:41, End Time: 2012-06-16 21:07:08 To: 1168, Order: 158602, Start Time: 2012-06-16 16:09:48, End Time: 2012-06-16 18:25:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (9 on baseline) Unchanged Tests: 892 (883 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.13% (0.3603 => 0.4040, std. dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.46% (2.0481 => 2.1189, std. dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.36% (0.2122 => 0.2257, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 1.23% (2.8036 => 2.8381, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.63% (2.4764 => 2.3866, std. dev.: 0.0263) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.4253 => 0.4141, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (4.6926 => 4.6275, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: -1.28% (0.7875 => 0.7774, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (2.7292 => 2.6969, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.18% (1.9966 => 1.9731, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.11% (2.1013 => 2.0779, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.06% (1.4269 => 1.4118, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (1.9694 => 1.9492, std. dev.: 0.0023) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 15:05:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 17:05:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616220510.747472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1174?compare_to=1171&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1174, Order: 158607, Start Time: 2012-06-16 21:09:53, End Time: 2012-06-16 22:06:33 To: 1171, Order: 158604, Start Time: 2012-06-16 19:19:08, End Time: 2012-06-16 20:16:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (766 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (0.4328 => 0.4517, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (3.9660 => 4.1191, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.81% (1.3693 => 1.4215, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.73% (0.9199 => 0.9542, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4062 => 0.4202, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.3245 => 1.3693, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.25% (2.1791 => 2.2500, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 3.23% (0.7038 => 0.7265, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.15% (0.3899 => 0.4022, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 3.07% (16.6129 => 17.1222, std. dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 3.05% (13.8202 => 14.2414, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 2.95% (1.2292 => 1.2654, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3580 => 0.3681, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9716, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.7710 => 0.7917, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.61% (1.9828 => 2.0346, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.4563 => 1.4923, std. dev.: 0.0074) MultiSource/Applications/treecc/treecc: 2.46% (1.9270 => 1.9745, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.2842 => 13.5895, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 2.06% (0.5818 => 0.5938, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.98% (1.3813 => 1.4087, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.3819 => 1.4090, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 1.90% (0.7061 => 0.7195, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 1.86% (0.5748 => 0.5855, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0878, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (3.2742 => 3.3234, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.24% (0.8698 => 0.8806, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7143, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4609, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.1007 => 2.1252, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6499, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (1.5188 => 1.5355, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2734, std. dev.: 0.0428) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1876, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3928, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7193, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5192, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7163, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1262, std. dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9026, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.66% (0.6576 => 0.6335, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.29% (33.2944 => 32.8640, std. dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.24% (0.9108 => 0.8995, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6027, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9554, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1201, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8968, std. dev.: 0.0652) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2309, std. dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2469, std. dev.: 0.0431) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 15:08:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 17:08:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616220839.B4CF32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1175?compare_to=1172&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1175, Order: 158607, Start Time: 2012-06-16 21:09:52, End Time: 2012-06-16 22:10:04 To: 1172, Order: 158604, Start Time: 2012-06-16 19:25:13, End Time: 2012-06-16 20:25:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (17 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (855 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.32% (10.4752 => 10.3368, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.60% (26.0924 => 26.7704, std. dev.: 0.0251) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.29% (0.8651 => 0.7242, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.66% (5.2763 => 4.7666, std. dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.87% (2.9384 => 2.6779, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.92% (1.1194 => 1.0419, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.43% (5.3855 => 5.0933, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -5.42% (54.1659 => 51.2296, std. dev.: 0.0386) MultiSource/Applications/ClamAV/clamscan: -4.63% (22.1758 => 21.1482, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.52% (6.6874 => 6.3851, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.98% (5.3526 => 5.1397, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.72% (2.2022 => 2.1422, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.48% (0.4879 => 0.4758, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.86% (7.0540 => 6.9229, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7326 => 0.7201, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.41% (7.9617 => 7.8492, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.28% (1.7609 => 1.7384, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (2.0665 => 2.0414, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.13% (8.1363 => 8.0445, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 16:28:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 18:28:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120616232818.650FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1176?compare_to=1174&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1176, Order: 158610, Start Time: 2012-06-16 22:33:05, End Time: 2012-06-16 23:29:41 To: 1174, Order: 158607, Start Time: 2012-06-16 21:09:53, End Time: 2012-06-16 22:06:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (763 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2952, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (3.9660 => 4.1151, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.75% (1.3693 => 1.4207, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9199 => 0.9533, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0594 => 1.0956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4062 => 0.4200, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (0.7038 => 0.7259, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.06% (2.1791 => 2.2457, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 3.02% (16.6129 => 17.1138, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2304, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.3899 => 0.4014, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.81% (1.2292 => 1.2637, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.9828 => 2.0363, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9628, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.4016 => 0.4118, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.48% (1.1061 => 1.1335, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5979, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9715, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.28% (0.4390 => 0.4490, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5577 => 0.5703, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4883, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 2.10% (0.5818 => 0.5940, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4088, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 1.93% (0.5748 => 0.5859, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (1.3813 => 1.4066, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7061 => 0.7186, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.47% (0.7506 => 0.7616, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0641, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.41% (3.2742 => 3.3203, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.8698 => 0.8804, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (3.6692 => 3.7126, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4476, std. dev.: 0.0171) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6473, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1221, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2715, std. dev.: 0.0385) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7308, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1448, std. dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7127, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.45% (0.5184 => 0.5311, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.41% (22.5627 => 20.8901, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.6576 => 0.6345, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.35% (33.2944 => 32.8463, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6082, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1238, std. dev.: 0.0251) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9588, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9600, std. dev.: 0.0318) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6990, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5116, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2403, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 16:35:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 18:35:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120616233532.8B06F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1177?compare_to=1175&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1177, Order: 158610, Start Time: 2012-06-16 22:36:40, End Time: 2012-06-16 23:36:56 To: 1175, Order: 158607, Start Time: 2012-06-16 21:09:52, End Time: 2012-06-16 22:10:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.60% (26.0924 => 26.7716, std. dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.30% (0.8651 => 0.7241, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.63% (5.2763 => 4.7683, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.78% (2.9384 => 2.6805, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.02% (1.1194 => 1.0408, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.44% (54.1659 => 51.2203, std. dev.: 0.0233) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.43% (5.3855 => 5.0932, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3817 => 0.3610, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -4.59% (22.1758 => 21.1574, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3896, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.99% (5.3526 => 5.1388, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.75% (2.2022 => 2.1417, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.52% (0.4879 => 0.4756, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.90% (7.0540 => 6.9197, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -1.68% (0.7326 => 0.7203, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.43% (7.9617 => 7.8476, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.26% (1.7609 => 1.7387, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (2.0665 => 2.0410, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.15% (8.1363 => 8.0426, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 16:47:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 18:47:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120616234750.35C472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1178?compare_to=1173&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1178, Order: 158607, Start Time: 2012-06-16 21:33:41, End Time: 2012-06-16 23:49:14 To: 1173, Order: 158604, Start Time: 2012-06-16 18:51:41, End Time: 2012-06-16 21:07:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (1 on baseline) Performance Improvements: 0 (4 on baseline) Unchanged Tests: 891 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.31% (0.9617 => 0.9839, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.23% (0.9865 => 0.9986, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2267 => 0.2393, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.46% (0.9697 => 0.9839, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.37% (2.4764 => 2.3930, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.08% (0.4253 => 0.4122, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (2.7292 => 2.6966, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.12% (1.9966 => 1.9742, std. dev.: 0.0068) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 18:04:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 20:04:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617010417.4CD1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1179?compare_to=1176&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1179, Order: 158611, Start Time: 2012-06-17 00:08:58, End Time: 2012-06-17 01:05:41 To: 1176, Order: 158610, Start Time: 2012-06-16 22:33:05, End Time: 2012-06-16 23:29:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (772 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2886, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4328 => 0.4493, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (3.9660 => 4.1140, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9199 => 0.9536, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.3245 => 1.3710, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.49% (0.5265 => 0.5449, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0594 => 1.0963, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.25% (2.1791 => 2.2499, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 3.16% (0.8310 => 0.8573, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.04% (1.3693 => 1.4109, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 3.00% (13.8202 => 14.2346, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 2.98% (0.7038 => 0.7248, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 2.81% (16.6129 => 17.0799, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (3.8646 => 3.9687, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.60% (1.1061 => 1.1349, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.60% (0.5577 => 0.5722, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.59% (0.3899 => 0.4000, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.4563 => 1.4933, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (13.2842 => 13.6161, std. dev.: 0.0170) MultiSource/Applications/treecc/treecc: 2.44% (1.9270 => 1.9741, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2292 => 1.2584, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.9828 => 2.0248, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.99% (1.3813 => 1.4088, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.65% (14.8535 => 15.0982, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (3.2742 => 3.3229, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.35% (0.7506 => 0.7607, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4785, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7172, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6564, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.4271 => 7.7049, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7141, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1321, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6837, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.37% (0.4657 => 0.3755, std. dev.: 0.0320) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8688, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.09% (0.3623 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.30% (0.3940 => 0.3810, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.6576 => 0.6363, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.48% (33.2944 => 32.8014, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.09% (4.9865 => 4.9322, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5886, std. dev.: 0.0166) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9557, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1191, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6987, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9713, std. dev.: 0.0351) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.13% (0.9692 => 0.9582, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 18:08:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 20:08:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617010802.40DDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1180?compare_to=1177&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1180, Order: 158611, Start Time: 2012-06-17 00:09:04, End Time: 2012-06-17 01:09:24 To: 1177, Order: 158610, Start Time: 2012-06-16 22:36:40, End Time: 2012-06-16 23:36:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (853 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.89% (0.3610 => 0.4256, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.50% (0.3817 => 0.4256, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7235, std. dev.: 0.0370) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.26% (0.8651 => 0.7244, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.44% (5.2763 => 4.7783, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.73% (2.9384 => 2.6818, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.91% (1.1194 => 1.0420, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -5.49% (54.1659 => 51.1929, std. dev.: 0.0479) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (5.3855 => 5.1068, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -4.59% (22.1758 => 21.1570, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (6.6874 => 6.3990, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.85% (5.3526 => 5.1464, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (2.2022 => 2.1444, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.36% (0.4879 => 0.4764, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -1.65% (0.7326 => 0.7205, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.65% (7.0540 => 6.9378, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.35% (2.0665 => 2.0386, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: -1.25% (1.5603 => 1.5408, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.24% (1.7609 => 1.7390, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (7.9617 => 7.8754, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: -1.04% (1.2842 => 1.2709, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 19:29:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 21:29:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617022942.7CDD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1181?compare_to=1178&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1181, Order: 158611, Start Time: 2012-06-17 00:15:45, End Time: 2012-06-17 02:31:06 To: 1178, Order: 158607, Start Time: 2012-06-16 21:33:41, End Time: 2012-06-16 23:49:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 893 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.18% (0.9839 => 0.9723, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.90% (0.3792 => 0.4281, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.50% (2.4764 => 2.3897, std. dev.: 0.0113) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 21:00:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 23:00:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617040035.16F372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1182?compare_to=1179&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1182, Order: 158613, Start Time: 2012-06-17 03:05:16, End Time: 2012-06-17 04:01:57 To: 1179, Order: 158611, Start Time: 2012-06-17 00:08:58, End Time: 2012-06-17 01:05:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (772 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.40% (2.0176 => 2.2880, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4328 => 0.4493, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (3.9660 => 4.1111, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.0594 => 1.0949, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3687, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.04% (0.8310 => 0.8563, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.02% (1.3693 => 1.4106, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.02% (2.1791 => 2.2448, std. dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 2.91% (13.8202 => 14.2221, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 2.81% (0.4062 => 0.4176, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.7710 => 0.7922, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.62% (16.6129 => 17.0475, std. dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (3.8646 => 3.9646, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6115, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 2.36% (1.2292 => 1.2582, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0067) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9714, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.99% (1.9828 => 2.0222, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (1.3813 => 1.4084, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (3.2742 => 3.3241, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0770, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (3.6692 => 3.7201, std. dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6512, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.12% (16.2614 => 16.4429, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1333 => 1.1452, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.65% (1.8175 => 2.2837, std. dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7233, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.37% (1.7688 => 1.8284, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5873, std. dev.: 0.0356) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1309, std. dev.: 0.0144) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2308 => 1.2463, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.97% (0.4657 => 0.3727, std. dev.: 0.0311) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.57% (22.5627 => 20.8547, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -3.60% (0.3940 => 0.3798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.22% (0.6576 => 0.6364, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.58% (33.2944 => 32.7671, std. dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.22% (4.9865 => 4.9259, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3056, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6027, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1123, std. dev.: 0.0455) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9056, std. dev.: 0.0553) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7011, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2341, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 21:06:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 16 Jun 2012 23:06:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617040644.84B252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1183?compare_to=1180&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1183, Order: 158613, Start Time: 2012-06-17 03:07:53, End Time: 2012-06-17 04:08:07 To: 1180, Order: 158611, Start Time: 2012-06-17 00:09:04, End Time: 2012-06-17 01:09:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (855 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7738, std. dev.: 0.0276) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.29% (0.8651 => 0.7242, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.46% (5.2763 => 4.7774, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.85% (2.9384 => 2.6783, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.91% (1.1194 => 1.0421, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.51% (54.1659 => 51.1830, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (5.3855 => 5.0991, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.59% (22.1758 => 21.1588, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.42% (6.6874 => 6.3920, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.86% (5.3526 => 5.1460, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (2.2022 => 2.1446, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.30% (0.4879 => 0.4767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.80% (7.0540 => 6.9269, std. dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: -1.68% (0.7326 => 0.7203, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.45% (2.0665 => 2.0365, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: -1.25% (1.5603 => 1.5408, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (1.7609 => 1.7398, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (7.9617 => 7.8689, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 22:18:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 00:18:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617051859.4162C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1184?compare_to=1181&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1184, Order: 158613, Start Time: 2012-06-17 03:05:01, End Time: 2012-06-17 05:20:23 To: 1181, Order: 158611, Start Time: 2012-06-17 00:15:45, End Time: 2012-06-17 02:31:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3923, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.4253 => 0.4140, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.10% (1.9966 => 1.9747, std. dev.: 0.0035) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 22:24:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 00:24:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617052409.7262C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1185?compare_to=1182&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1185, Order: 158621, Start Time: 2012-06-17 04:28:57, End Time: 2012-06-17 05:25:32 To: 1182, Order: 158613, Start Time: 2012-06-17 03:05:16, End Time: 2012-06-17 04:01:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (774 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4328 => 0.4505, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1088, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5265 => 0.5450, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9199 => 0.9515, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.10% (0.8310 => 0.8568, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.10% (1.3693 => 1.4117, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4062 => 0.4185, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2431, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2153, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.64% (0.3899 => 0.4002, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7038 => 0.7218, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9629, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0339, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6087, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2292 => 1.2579, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.25% (1.9270 => 1.9704, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4114, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (1.9828 => 2.0240, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.03% (1.3813 => 1.4093, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0865, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.2742 => 3.3214, std. dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7164, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4580, std. dev.: 0.0218) MultiSource/Applications/JM/ldecod/ldecod: 1.14% (6.5754 => 6.6504, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3997, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7367, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5867, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7126, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1312, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.31% (1.9290 => 1.9542, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.5627 => 20.8634, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3601 => 0.3462, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.22% (0.6576 => 0.6364, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.30% (0.8818 => 0.8615, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.66% (33.2944 => 32.7427, std. dev.: 0.0206) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.31% (0.9108 => 0.8989, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (4.9865 => 4.9268, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5760, std. dev.: 0.0164) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1196, std. dev.: 0.0179) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.22% (20.3410 => 19.8886, std. dev.: 0.0450) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2361, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2556, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 22:34:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 00:34:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617053403.731252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1186?compare_to=1183&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1186, Order: 158625, Start Time: 2012-06-17 04:35:08, End Time: 2012-06-17 05:35:28 To: 1183, Order: 158613, Start Time: 2012-06-17 03:07:53, End Time: 2012-06-17 04:08:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.45% (26.0924 => 26.7320, std. dev.: 0.0378) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.19% (0.8651 => 0.7250, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.37% (5.2763 => 4.7820, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.75% (2.9384 => 2.6812, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.90% (1.1194 => 1.0422, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2338, std. dev.: 0.0460) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3817 => 0.3612, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (5.3855 => 5.1106, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -4.62% (22.1758 => 21.1509, std. dev.: 0.0204) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.25% (6.6874 => 6.4034, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.65% (5.3526 => 5.1572, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.18% (2.2022 => 2.1543, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.48% (2.0665 => 2.0359, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.45% (7.0540 => 6.9519, std. dev.: 0.0082) MultiSource/Applications/hbd/hbd: -1.05% (1.5603 => 1.5439, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -1.03% (1.2842 => 1.2710, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (7.9617 => 7.8810, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 16 23:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 01:47:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617064727.CB8742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1187?compare_to=1185&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1187, Order: 158629, Start Time: 2012-06-17 05:52:13, End Time: 2012-06-17 06:48:51 To: 1185, Order: 158621, Start Time: 2012-06-17 04:28:57, End Time: 2012-06-17 05:25:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (75 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.73% (2.0176 => 2.2947, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1095, std. dev.: 0.0100) MultiSource/Applications/hbd/hbd: 3.60% (1.3693 => 1.4186, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4062 => 0.4205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.25% (0.7038 => 0.7267, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3899 => 0.4023, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2455, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3489 => 0.3594, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3638, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.0993, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.79% (0.3580 => 0.3680, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2292 => 1.2634, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (1.9828 => 2.0379, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1950, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5637 => 0.5789, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9672, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.49% (0.4016 => 0.4116, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.7710 => 0.7896, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.2842 => 13.5900, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.28% (1.1364 => 1.1623, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9701, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4867, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 2.03% (0.5818 => 0.5936, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.67% (0.7061 => 0.7179, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.27% (1.3819 => 1.3994, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.25% (0.8698 => 0.8807, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.18% (1.3813 => 1.3976, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0181, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (3.6692 => 3.7081, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std. dev.: 0.0377) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.35% (1.5824 => 1.6987, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7170, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5169, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5840, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.75% (7.9275 => 8.1455, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.68% (4.5928 => 4.7158, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.56% (0.4657 => 0.3839, std. dev.: 0.0291) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8403, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3650 => 0.3523, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.35% (0.6576 => 0.6356, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.82% (0.4003 => 0.3890, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.41% (33.2944 => 32.8236, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (4.9865 => 4.9364, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.49% (1.9762 => 1.9072, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std. dev.: 0.0144) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1177, std. dev.: 0.0246) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9564, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9061, std. dev.: 0.0863) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6986, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2254, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 00:01:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 02:01:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617070132.8D0F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1188?compare_to=1186&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1188, Order: 158629, Start Time: 2012-06-17 06:02:01, End Time: 2012-06-17 07:02:55 To: 1186, Order: 158625, Start Time: 2012-06-17 04:35:08, End Time: 2012-06-17 05:35:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (853 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.58% (0.3612 => 0.4283, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.21% (0.3817 => 0.4283, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.39% (26.0924 => 26.7160, std. dev.: 0.0548) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7781 => 3.8293, std. dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.24% (0.8651 => 0.7246, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.54% (5.2763 => 4.7730, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.79% (2.9384 => 2.6800, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.90% (1.1194 => 1.0422, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.45% (54.1659 => 51.2122, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.20% (5.3855 => 5.1055, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -4.64% (22.1758 => 21.1475, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.54% (6.6874 => 6.3839, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.70% (5.3526 => 5.1546, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.22% (2.2022 => 2.1534, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.07% (0.4879 => 0.4778, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.75% (7.0540 => 6.9309, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: -1.38% (0.7326 => 0.7225, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: -1.20% (1.5603 => 1.5416, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (7.9617 => 7.8727, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.08% (1.7609 => 1.7419, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.2842 => 1.2711, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 01:04:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 03:04:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617080432.EB71D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1189?compare_to=1184&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1189, Order: 158629, Start Time: 2012-06-17 05:47:00, End Time: 2012-06-17 08:05:56 To: 1184, Order: 158613, Start Time: 2012-06-17 03:05:01, End Time: 2012-06-17 05:20:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 892 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.35% (2.0727 => 2.1215, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.81% (0.6290 => 0.6404, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (2.0820 => 2.1215, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.76% (0.6293 => 0.6404, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.37% (2.4764 => 2.3929, std. dev.: 0.0124) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 01:15:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 03:15:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617081545.39A5E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1190?compare_to=1187&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1190, Order: 158633, Start Time: 2012-06-17 07:20:21, End Time: 2012-06-17 08:17:09 To: 1187, Order: 158629, Start Time: 2012-06-17 05:52:13, End Time: 2012-06-17 06:48:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2951, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.25% (0.4328 => 0.4512, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4062 => 0.4214, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (3.9660 => 4.1108, std. dev.: 0.0109) MultiSource/Applications/hbd/hbd: 3.59% (1.3693 => 1.4184, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7038 => 0.7271, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.15% (0.3899 => 0.4022, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.06% (2.1791 => 2.2458, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3648, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.03% (16.6129 => 17.1165, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (1.9828 => 2.0400, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3580 => 0.3682, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2292 => 1.2634, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.72% (13.8202 => 14.1967, std. dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (3.8646 => 3.9625, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.43% (1.1061 => 1.1330, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4390 => 0.4495, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2480, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.35% (0.7710 => 0.7891, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5795, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.21% (1.9270 => 1.9696, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 1.96% (0.5818 => 0.5932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.7061 => 0.7175, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.8698 => 0.8805, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.12% (3.6692 => 3.7102, std. dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0176, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2616, std. dev.: 0.0520) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7171, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5185, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.06% (7.9275 => 8.1702, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5839, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7148, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.2308 => 1.2446, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.66% (22.5627 => 20.8343, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.75% (0.3623 => 0.3487, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.58% (0.3663 => 0.3532, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.46% (0.3646 => 0.3520, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.32% (0.6576 => 0.6358, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -3.14% (0.3789 => 0.3670, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.01% (0.3914 => 0.3796, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.87% (0.4003 => 0.3888, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.45% (33.2944 => 32.8106, std. dev.: 0.0217) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (4.9865 => 4.9345, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5820, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.36% (9.3358 => 9.1153, std. dev.: 0.0143) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9592, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6990, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9669, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4876, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2356, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8687, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 01:32:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 03:32:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617083212.326192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1191?compare_to=1188&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1191, Order: 158635, Start Time: 2012-06-17 07:32:54, End Time: 2012-06-17 08:33:33 To: 1188, Order: 158629, Start Time: 2012-06-17 06:02:01, End Time: 2012-06-17 07:02:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7981, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.28% (0.8651 => 0.7243, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.54% (5.2763 => 4.7730, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.89% (2.9384 => 2.6771, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.91% (1.1194 => 1.0420, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.37% (54.1659 => 51.2590, std. dev.: 0.0582) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.21% (5.3855 => 5.1047, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -4.55% (22.1758 => 21.1670, std. dev.: 0.0292) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.51% (6.6874 => 6.3859, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.77% (5.3526 => 5.1506, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.23% (2.2022 => 2.1530, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.09% (0.4879 => 0.4777, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.59% (7.0540 => 6.9419, std. dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (7.9617 => 7.8639, std. dev.: 0.0174) MultiSource/Applications/hbd/hbd: -1.18% (1.5603 => 1.5419, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.14% (2.0665 => 2.0429, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7411, std. dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 02:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 04:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617093913.0BBE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1192?compare_to=1190&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1192, Order: 158636, Start Time: 2012-06-17 08:43:48, End Time: 2012-06-17 09:40:36 To: 1190, Order: 158633, Start Time: 2012-06-17 07:20:21, End Time: 2012-06-17 08:17:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (75 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (769 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.22% (7.9502 => 8.0472, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.43% (1.4088 => 1.3887, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.72% (2.0176 => 2.2944, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 4.23% (0.4328 => 0.4511, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4062 => 0.4212, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.62% (1.3693 => 1.4189, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.61% (3.9660 => 4.1093, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.60% (0.2945 => 0.3051, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.0594 => 1.0930, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (0.7038 => 0.7259, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.13% (0.3899 => 0.4021, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.10% (2.1791 => 2.2466, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.95% (0.3489 => 0.3592, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0927, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3580 => 0.3681, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2080, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.2292 => 1.2635, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (1.9828 => 2.0367, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9632, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1337, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.7710 => 0.7887, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.23% (1.9270 => 1.9700, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5778, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4874, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 1.94% (0.5818 => 0.5931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.76% (0.5748 => 0.5849, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 1.57% (0.7061 => 0.7172, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (0.8698 => 0.8809, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0386, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3991, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (1.3813 => 1.3982, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7097, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3084, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.62% (1.8175 => 2.3014, std. dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.84% (1.2998 => 1.3887, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5187, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5857, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1510, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 2.58% (4.5928 => 4.7114, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2450, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.66% (22.5627 => 20.8336, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3623 => 0.3491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.63% (0.3578 => 0.3448, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.61% (0.3601 => 0.3471, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -3.58% (0.3663 => 0.3532, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.48% (0.8818 => 0.8511, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.33% (0.6576 => 0.6357, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -3.25% (0.3789 => 0.3666, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.10% (0.3940 => 0.3818, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.96% (0.3914 => 0.3798, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.43% (33.2944 => 32.8169, std. dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (4.9865 => 4.9357, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5957, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1233, std. dev.: 0.0142) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9286, std. dev.: 0.0215) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2548, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2367, std. dev.: 0.0236) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 02:59:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 04:59:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617095916.69FA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1193?compare_to=1191&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1193, Order: 158636, Start Time: 2012-06-17 09:00:23, End Time: 2012-06-17 10:00:41 To: 1191, Order: 158635, Start Time: 2012-06-17 07:32:54, End Time: 2012-06-17 08:33:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.3079 => 1.3260, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7818, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (1.3045 => 1.3260, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.22% (0.8651 => 0.7248, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.51% (5.2763 => 4.7746, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.78% (2.9384 => 2.6803, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.91% (1.1194 => 1.0420, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2702, std. dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (5.3855 => 5.1022, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.50% (6.6874 => 6.3862, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -4.50% (22.1758 => 21.1775, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.76% (5.3526 => 5.1513, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.22% (2.2022 => 2.1533, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.05% (0.4879 => 0.4779, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.67% (7.0540 => 6.9360, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.37% (2.0665 => 2.0382, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (7.9617 => 7.8658, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 03:46:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 05:46:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617104632.2C2342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1194?compare_to=1189&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1194, Order: 158636, Start Time: 2012-06-17 08:32:37, End Time: 2012-06-17 10:47:57 To: 1189, Order: 158629, Start Time: 2012-06-17 05:47:00, End Time: 2012-06-17 08:05:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 1 (4 on baseline) Unchanged Tests: 893 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6404 => 0.6285, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.32% (2.4764 => 2.3941, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7171 => 0.7054, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (4.6926 => 4.6402, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.05% (1.9694 => 1.9488, std. dev.: 0.0053) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 04:02:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 06:02:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617110228.61D0C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1195?compare_to=1192&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1195, Order: 158638, Start Time: 2012-06-17 10:07:13, End Time: 2012-06-17 11:03:53 To: 1192, Order: 158636, Start Time: 2012-06-17 08:43:48, End Time: 2012-06-17 09:40:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (776 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.75% (0.3684 => 0.3896, std. dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.76% (2.0176 => 2.2751, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.04% (0.4328 => 0.4503, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.37% (0.4062 => 0.4199, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.07% (1.3693 => 1.4113, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (3.9660 => 4.0866, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9199 => 0.9478, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.72% (1.3245 => 1.3605, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.69% (0.3899 => 0.4004, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.7710 => 0.7912, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (1.9828 => 2.0324, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2292 => 1.2591, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.41% (2.1791 => 2.2317, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.34% (16.6129 => 17.0009, std. dev.: 0.0209) MultiSource/Applications/SPASS/SPASS: 2.32% (13.8202 => 14.1407, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 2.11% (0.5818 => 0.5941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2193 => 1.2449, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9425, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5424, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 1.93% (0.5748 => 0.5859, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 1.91% (1.1061 => 1.1272, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9617, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.80% (1.4563 => 1.4825, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 1.80% (0.7061 => 0.7188, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (1.3813 => 1.3981, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0453) SingleSource/Benchmarks/Misc/mandel-2: 9.26% (1.2998 => 1.4201, std. dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.73% (0.9996 => 1.0769, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7418, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7149, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1212, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.12% (0.5184 => 0.5294, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.34% (0.4657 => 0.3896, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.94% (22.5627 => 20.7715, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.89% (0.8818 => 0.8475, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3601 => 0.3462, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.74% (0.3663 => 0.3526, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.86% (0.6576 => 0.6388, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.14% (0.9108 => 0.8913, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.87% (33.2944 => 32.6720, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (4.9865 => 4.9196, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2120, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6000, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -2.54% (9.3358 => 9.0987, std. dev.: 0.0525) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9592, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9202, std. dev.: 0.0336) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6990, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 04:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 06:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617112632.1C3512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1196?compare_to=1193&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1196, Order: 158638, Start Time: 2012-06-17 10:27:30, End Time: 2012-06-17 11:27:57 To: 1193, Order: 158636, Start Time: 2012-06-17 09:00:23, End Time: 2012-06-17 10:00:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 1 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (855 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.53% (10.3348 => 9.8664, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.69% (26.0924 => 26.7934, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3045 => 1.3186, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.48% (0.8651 => 0.7312, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (5.2763 => 4.7969, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (2.9384 => 2.6925, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0467, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3493, std. dev.: 0.0186) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.96% (5.3855 => 5.1182, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -4.83% (10.3673 => 9.8664, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -4.60% (22.1758 => 21.1552, std. dev.: 0.0237) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.95% (6.6874 => 6.4233, std. dev.: 0.0190) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.40% (5.3526 => 5.1708, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.50% (2.2022 => 2.1471, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.99% (7.0540 => 6.9134, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.50% (2.0665 => 2.0356, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (7.9617 => 7.8593, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.16% (8.1363 => 8.0423, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: -1.03% (1.5603 => 1.5442, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 05:25:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 07:25:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617122547.78A872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1197?compare_to=1195&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1197, Order: 158640, Start Time: 2012-06-17 11:30:31, End Time: 2012-06-17 12:27:12 To: 1195, Order: 158638, Start Time: 2012-06-17 10:07:13, End Time: 2012-06-17 11:03:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (765 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.13% (2.0176 => 2.2826, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.60% (0.4328 => 0.4527, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4062 => 0.4223, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.2781 => 0.2884, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.61% (1.3693 => 1.4188, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.47% (0.3022 => 0.3127, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0968, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.23% (0.3899 => 0.4025, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3107 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.21% (0.3149 => 0.3250, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (1.9828 => 2.0463, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.17% (0.9199 => 0.9491, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3489 => 0.3597, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.02% (0.3580 => 0.3688, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (1.2292 => 1.2660, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3485 => 0.3585, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.3868 => 0.3976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4016 => 0.4127, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4390 => 0.4511, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1841, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 2.63% (0.7038 => 0.7223, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.45% (16.6129 => 17.0196, std. dev.: 0.0088) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2319, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2193 => 1.2459, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 2.11% (0.5818 => 0.5941, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.10% (1.1061 => 1.1293, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9449, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5462, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4848, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9638, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 1.83% (0.5748 => 0.5853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7061 => 0.7186, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.8698 => 0.8817, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (1.3813 => 1.3990, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.06% (14.8535 => 15.0110, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.18% (1.8175 => 2.2752, std. dev.: 0.0437) SingleSource/Benchmarks/Misc/mandel-2: 8.58% (1.2998 => 1.4113, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1875, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7305, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9228, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.91% (11.2619 => 11.5895, std. dev.: 0.0359) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1361, std. dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7130, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8412, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.8818 => 0.8513, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: -3.45% (0.3940 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.6576 => 0.6369, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -2.97% (0.4003 => 0.3884, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (0.9108 => 0.8939, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.61% (33.2944 => 32.7590, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (4.9865 => 4.9270, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6010, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1110, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9551, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9137, std. dev.: 0.0130) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6996, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2551, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2378, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8708, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 05:53:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 07:53:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617125340.A296B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1198?compare_to=1196&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1198, Order: 158640, Start Time: 2012-06-17 11:54:41, End Time: 2012-06-17 12:55:03 To: 1196, Order: 158638, Start Time: 2012-06-17 10:27:30, End Time: 2012-06-17 11:27:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.86% (9.8664 => 10.1482, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2299 => 1.2450, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7787, std. dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.12% (1.3045 => 1.3191, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.28% (0.8651 => 0.7329, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7938, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.61% (2.9384 => 2.6854, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (1.1194 => 1.0435, std. dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3278, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (5.3855 => 5.1064, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -4.78% (22.1758 => 21.1157, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.07% (6.6874 => 6.4151, std. dev.: 0.0294) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.64% (5.3526 => 5.1577, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.85% (2.2022 => 2.1395, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.34% (0.4879 => 0.4765, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (10.3673 => 10.1482, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.98% (7.0540 => 6.9142, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.62% (2.0665 => 2.0330, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -1.30% (1.2842 => 1.2675, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (7.9617 => 7.8582, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.27% (8.1363 => 8.0329, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 06:28:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 08:28:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617132820.390242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1199?compare_to=1194&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1199, Order: 158640, Start Time: 2012-06-17 11:14:28, End Time: 2012-06-17 13:29:44 To: 1194, Order: 158636, Start Time: 2012-06-17 08:32:37, End Time: 2012-06-17 10:47:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (0 on baseline) Performance Improvements: 0 (5 on baseline) Unchanged Tests: 891 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.62% (0.7054 => 0.7168, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.18% (0.9844 => 0.9960, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.11% (0.9609 => 0.9716, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.35% (1.9694 => 1.9429, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.33% (1.9966 => 1.9700, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: -1.32% (0.7875 => 0.7771, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (2.7292 => 2.6976, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.6926 => 4.6428, std. dev.: 0.0130) Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 07:14:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 09:14:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617141451.EFC852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1200?compare_to=1197&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1200, Order: 158646, Start Time: 2012-06-17 13:19:43, End Time: 2012-06-17 14:16:16 To: 1197, Order: 158640, Start Time: 2012-06-17 11:30:31, End Time: 2012-06-17 12:27:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.79% (0.4024 => 0.3630, std. dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2820, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4328 => 0.4499, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0973, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.25% (0.4062 => 0.4194, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9199 => 0.9494, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.84% (1.3693 => 1.4082, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3245 => 1.3620, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.67% (0.3899 => 0.4003, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1624, std. dev.: 0.0084) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2330, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.7710 => 0.7894, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0059, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (1.9828 => 2.0292, std. dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: 2.29% (1.2292 => 1.2573, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1364 => 1.1617, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9464, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4870, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5342, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9622, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 1.74% (0.5818 => 0.5919, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.46% (0.7061 => 0.7164, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.41% (1.3813 => 1.4008, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std. dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.52% (1.2998 => 1.3845, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7292, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5177, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1542, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7168, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9531, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.05% (0.4657 => 0.3630, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.01% (22.5627 => 20.7546, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.82% (0.8818 => 0.8481, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.81% (0.3623 => 0.3485, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3650 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.58% (0.3578 => 0.3450, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.33% (0.3789 => 0.3663, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.3914 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -2.20% (33.2944 => 32.5617, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.03% (0.9108 => 0.8923, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (4.9865 => 4.9283, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2074, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.82% (1.3780 => 1.3254, std. dev.: 0.0146) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9569, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -2.23% (9.3358 => 9.1276, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9499, std. dev.: 0.0648) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6985, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2406, std. dev.: 0.0211) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 07:20:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 09:20:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617142055.E0A9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1201?compare_to=1198&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1201, Order: 158646, Start Time: 2012-06-17 13:21:50, End Time: 2012-06-17 14:22:19 To: 1198, Order: 158640, Start Time: 2012-06-17 11:54:41, End Time: 2012-06-17 12:55:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 4.93% (21.1157 => 22.1567, std. dev.: 0.0085) MultiSource/Benchmarks/PAQ8p/paq8p: 3.73% (10.1482 => 10.5272, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (10.3673 => 10.5272, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7552, std. dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.06% (0.8651 => 0.7262, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.76% (5.2763 => 4.8140, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.25% (2.9384 => 2.6961, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0468, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (5.3855 => 5.1092, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.3957, std. dev.: 0.0257) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.88% (5.3526 => 5.1447, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.50% (6.6874 => 6.4536, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.95% (2.2022 => 2.1372, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.13% (0.4879 => 0.4775, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.64% (7.0540 => 6.9382, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (7.9617 => 7.8620, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: -1.23% (1.5603 => 1.5411, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7412, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 09:10:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 11:10:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617161017.E9F402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1202?compare_to=1199&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1202, Order: 158646, Start Time: 2012-06-17 13:56:21, End Time: 2012-06-17 16:11:42 To: 1199, Order: 158640, Start Time: 2012-06-17 11:14:28, End Time: 2012-06-17 13:29:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (1 on baseline) Performance Improvements: 1 (4 on baseline) Unchanged Tests: 891 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 19.17% (0.3521 => 0.4196, std. dev.: 0.0245) SingleSource/UnitTests/Vector/constpool: 1.44% (2.3983 => 2.4329, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.53% (0.7168 => 0.7058, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.2122 => 0.2266, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.76% (2.4764 => 2.4329, std. dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: -1.58% (0.7171 => 0.7058, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.23% (1.9694 => 1.9451, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.06% (1.9966 => 1.9754, std. dev.: 0.0009) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 09:11:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 11:11:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617161109.A6A402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1203?compare_to=1200&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1203, Order: 158647, Start Time: 2012-06-17 15:15:55, End Time: 2012-06-17 16:12:34 To: 1200, Order: 158646, Start Time: 2012-06-17 13:19:43, End Time: 2012-06-17 14:16:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.25% (1.3254 => 1.3088, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2799, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4328 => 0.4505, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.6959 => 0.7196, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0962, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4062 => 0.4193, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.01% (0.9199 => 0.9476, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.94% (1.3693 => 1.4095, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.74% (1.3245 => 1.3608, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.7710 => 0.7915, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2292 => 1.2584, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.35% (13.8202 => 14.1446, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.32% (1.9828 => 2.0289, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.31% (16.6129 => 16.9974, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.11% (3.8646 => 3.9460, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1364 => 1.1597, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.97% (1.1061 => 1.1279, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5330, std. dev.: 0.0121) SingleSource/UnitTests/ObjC++/property-reference-object: 1.84% (0.5818 => 0.5925, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 1.47% (0.7061 => 0.7165, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4010, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0094, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2744, std. dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.22% (1.2998 => 1.3937, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7184, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5863, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1542, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7154, std. dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5159, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9530, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.98% (0.4657 => 0.3773, std. dev.: 0.0241) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.11% (22.5627 => 20.7337, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.82% (0.8818 => 0.8481, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.66% (0.3578 => 0.3447, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.00% (0.4003 => 0.3883, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -2.20% (33.2944 => 32.5620, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.97% (0.9108 => 0.8929, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (4.9865 => 4.9280, std. dev.: 0.0190) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2071, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6150, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1177, std. dev.: 0.0142) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9596, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.12% (6.6320 => 6.4912, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9115, std. dev.: 0.0597) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6967, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2551, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8575, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2299, std. dev.: 0.0291) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 09:17:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 11:17:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617161737.C77D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1204?compare_to=1201&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1204, Order: 158647, Start Time: 2012-06-17 15:18:45, End Time: 2012-06-17 16:19:03 To: 1201, Order: 158646, Start Time: 2012-06-17 13:21:50, End Time: 2012-06-17 14:22:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (10.3673 => 10.5375, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.51% (26.0924 => 26.7467, std. dev.: 0.0328) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.06% (0.8651 => 0.7262, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.78% (5.2763 => 4.8129, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.38% (2.9384 => 2.6923, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.15% (1.1194 => 1.0506, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (5.3855 => 5.1075, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4551, std. dev.: 0.0187) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.88% (5.3526 => 5.1451, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.52% (6.6874 => 6.4519, std. dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.99% (2.2022 => 2.1363, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.17% (0.4879 => 0.4773, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.67% (7.0540 => 6.9365, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -1.38% (0.7326 => 0.7225, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: -1.27% (1.5603 => 1.5405, std. dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.24% (7.9617 => 7.8633, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.14% (1.7609 => 1.7408, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 10:34:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 12:34:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120617173425.E4CEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1205?compare_to=1203&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1205, Order: 158650, Start Time: 2012-06-17 16:39:16, End Time: 2012-06-17 17:35:50 To: 1203, Order: 158647, Start Time: 2012-06-17 15:15:55, End Time: 2012-06-17 16:12:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.49% (3.8447 => 3.7873, std. dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2799, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.84% (0.4328 => 0.4494, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.6959 => 0.7196, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0967, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.20% (0.4062 => 0.4192, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9199 => 0.9484, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.89% (1.3693 => 1.4089, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.72% (1.3245 => 1.3605, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 2.43% (0.7038 => 0.7209, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1470, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.34% (16.6129 => 17.0018, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.27% (1.2292 => 1.2571, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.9828 => 2.0274, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.11% (3.8646 => 3.9460, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1364 => 1.1597, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5435, std. dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference-object: 1.82% (0.5818 => 0.5924, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.78% (1.9270 => 1.9613, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.4563 => 1.4815, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4017, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4020, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.38% (1.8175 => 2.2969, std. dev.: 0.0353) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1936, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9190, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5186, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5858, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7150, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1312, std. dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1920, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.09% (22.5627 => 20.7363, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (0.8818 => 0.8479, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -3.84% (0.3623 => 0.3484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.38% (0.3940 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.25% (0.3789 => 0.3666, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -2.19% (33.2944 => 32.5648, std. dev.: 0.0257) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.97% (0.9108 => 0.8929, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.24% (4.9865 => 4.9247, std. dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2074, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.39% (1.3780 => 1.3175, std. dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6042, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -2.44% (9.3358 => 9.1078, std. dev.: 0.0478) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9599, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9061, std. dev.: 0.0383) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.44% (6.3560 => 6.2645, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std. dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 10:44:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 12:44:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120617174441.9C6EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1206?compare_to=1204&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1206, Order: 158650, Start Time: 2012-06-17 16:45:39, End Time: 2012-06-17 17:46:06 To: 1204, Order: 158647, Start Time: 2012-06-17 15:18:45, End Time: 2012-06-17 16:19:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (10.3673 => 10.5274, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.46% (26.0924 => 26.7332, std. dev.: 0.0263) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.96% (0.8651 => 0.7270, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.72% (5.2763 => 4.8160, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (2.9384 => 2.6930, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.00% (1.1194 => 1.0522, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (5.3855 => 5.1093, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4402, std. dev.: 0.0323) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.85% (5.3526 => 5.1464, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.46% (6.6874 => 6.4562, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.91% (2.2022 => 2.1381, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.15% (0.4879 => 0.4774, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.68% (7.0540 => 6.9354, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7326 => 0.7224, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: -1.12% (1.5603 => 1.5428, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (7.9617 => 7.8728, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.04% (1.7609 => 1.7426, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 11:52:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 13:52:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120617185205.8826D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1207?compare_to=1202&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1207, Order: 158650, Start Time: 2012-06-17 16:38:17, End Time: 2012-06-17 18:53:30 To: 1202, Order: 158646, Start Time: 2012-06-17 13:56:21, End Time: 2012-06-17 16:11:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (0 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (892 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.2270 => 0.2391, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.22% (1.9966 => 1.9722, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.19% (1.9694 => 1.9460, std. dev.: 0.0021) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 17:40:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 19:40:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618004015.2702F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1208?compare_to=1205&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1208, Order: 158651, Start Time: 2012-06-17 23:45:07, End Time: 2012-06-18 00:41:39 To: 1205, Order: 158650, Start Time: 2012-06-17 16:39:16, End Time: 2012-06-17 17:35:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (781 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.29% (2.2969 => 2.2672, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.09% (2.0176 => 2.2818, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.4328 => 0.4501, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.4062 => 0.4198, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0978, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9199 => 0.9479, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 2.91% (1.3693 => 1.4092, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.3245 => 1.3609, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 2.52% (2.1791 => 2.2340, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (1.9828 => 2.0309, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0159, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.7038 => 0.7205, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.36% (1.2292 => 1.2582, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.35% (13.8202 => 14.1447, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.23% (1.2193 => 1.2465, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (3.8646 => 3.9486, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (13.2842 => 13.5518, std. dev.: 0.0121) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4027, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.47% (1.3813 => 1.4016, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4014, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7368, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7132, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1305, std. dev.: 0.0176) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.06% (4.1080 => 4.1926, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.25% (0.4657 => 0.3714, std. dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.03% (22.5627 => 20.7518, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.82% (0.8818 => 0.8481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3650 => 0.3525, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.14% (0.3663 => 0.3548, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.82% (0.4003 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.94% (33.2944 => 32.6494, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.93% (0.9108 => 0.8932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (4.9865 => 4.9272, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (6.2785 => 6.2113, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.15% (0.3139 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0126) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5908, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (20.3410 => 19.8541, std. dev.: 0.0522) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9566, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1240, std. dev.: 0.0413) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4867 => 0.4761, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (0.9692 => 0.9573, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2415, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 17:46:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 19:46:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618004658.BC7C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1209?compare_to=1206&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1209, Order: 158651, Start Time: 2012-06-17 23:47:52, End Time: 2012-06-18 00:48:23 To: 1206, Order: 158650, Start Time: 2012-06-17 16:45:39, End Time: 2012-06-17 17:46:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.32% (3.7582 => 3.7087, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (10.3673 => 10.4781, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7583, std. dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3180, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.16% (0.8651 => 0.7253, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.15% (5.2763 => 4.7933, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.51% (2.9384 => 2.6883, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.65% (1.1194 => 1.0450, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (5.3855 => 5.1022, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.08% (54.1659 => 51.4136, std. dev.: 0.0560) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.05% (5.3526 => 5.1358, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.98% (6.6874 => 6.4214, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.08% (2.2022 => 2.1343, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.17% (0.4879 => 0.4773, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.74% (7.0540 => 6.9310, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.24% (1.7609 => 1.7390, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (7.9617 => 7.8664, std. dev.: 0.0140) MultiSource/Applications/hbd/hbd: -1.19% (1.5603 => 1.5417, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 17 18:59:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 17 Jun 2012 20:59:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618015927.43A032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1210?compare_to=1207&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1210, Order: 158651, Start Time: 2012-06-17 23:45:10, End Time: 2012-06-18 02:00:50 To: 1207, Order: 158650, Start Time: 2012-06-17 16:38:17, End Time: 2012-06-17 18:53:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (893 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.52% (0.7171 => 0.7062, std. dev.: 0.0029) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 00:43:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 02:43:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618074304.43DD52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1211?compare_to=1208&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1211, Order: 158652, Start Time: 2012-06-18 06:45:05, End Time: 2012-06-18 07:44:28 To: 1208, Order: 158651, Start Time: 2012-06-17 23:45:07, End Time: 2012-06-18 00:41:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (784 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0627) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4328 => 0.4492, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4062 => 0.4202, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0972, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9199 => 0.9490, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3638, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.84% (1.3693 => 1.4082, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2375, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.7710 => 0.7914, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7038 => 0.7218, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0186, std. dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1555, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9514, std. dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: 2.16% (1.2292 => 1.2557, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (13.2842 => 13.5689, std. dev.: 0.0104) MultiSource/Applications/Burg/burg: 2.08% (1.1061 => 1.1291, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9669, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.3813 => 1.4038, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0055, std. dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0562) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 7.41% (1.2998 => 1.3961, std. dev.: 0.0093) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7345, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5193, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.99% (7.9275 => 8.1648, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7148, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.5184 => 0.5315, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.06% (4.1080 => 4.1925, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.87% (22.5627 => 20.7874, std. dev.: 0.3810) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: -4.31% (0.3646 => 0.3489, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.3789 => 0.3632, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/property: -4.11% (0.3940 => 0.3778, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.6576 => 0.6376, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (4.9865 => 4.9317, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2119, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0218) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.22% (20.3410 => 19.6869, std. dev.: 0.1003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0776) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1135, std. dev.: 0.0514) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9560, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.1161) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2500, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4884, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2481, std. dev.: 0.0367) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 00:46:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 02:46:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618074646.B39852A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1212?compare_to=1209&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1212, Order: 158652, Start Time: 2012-06-18 06:45:24, End Time: 2012-06-18 07:48:10 To: 1209, Order: 158651, Start Time: 2012-06-17 23:47:52, End Time: 2012-06-18 00:48:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (1 on baseline) Performance Improvements: 1 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (860 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 1.46% (0.7253 => 0.7359, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.43% (10.4781 => 10.1189, std. dev.: 0.1262) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7250, std. dev.: 0.0442) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.93% (0.8651 => 0.7359, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.82% (5.2763 => 4.8109, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (2.9384 => 2.6940, std. dev.: 0.0708) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (1.1194 => 1.0447, std. dev.: 0.0154) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3102, std. dev.: 0.3846) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.87% (5.3855 => 5.1231, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.41% (6.6874 => 6.4595, std. dev.: 0.0679) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.85% (2.2022 => 2.1395, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.61% (7.0540 => 6.9407, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.32% (7.9617 => 7.8569, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.1363 => 8.0460, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -1.05% (10.4361 => 10.3270, std. dev.: 0.0126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 02:01:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 04:01:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618090116.8A2232A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1213?compare_to=1210&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1213, Order: 158652, Start Time: 2012-06-18 06:45:21, End Time: 2012-06-18 09:02:41 To: 1210, Order: 158651, Start Time: 2012-06-17 23:45:10, End Time: 2012-06-18 02:00:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Improvements: 0 (5 on baseline) Unchanged Tests: 894 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.68% (2.4764 => 2.4100, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.4253 => 0.4150, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.45% (1.9966 => 1.9677, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (2.7292 => 2.6937, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.30% (1.9694 => 1.9438, std. dev.: 0.0017) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 02:06:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 04:06:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618090642.0AD442A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1214?compare_to=1211&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1214, Order: 158654, Start Time: 2012-06-18 08:11:20, End Time: 2012-06-18 09:08:06 To: 1211, Order: 158652, Start Time: 2012-06-18 06:45:05, End Time: 2012-06-18 07:44:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.39% (19.6869 => 19.9609, std. dev.: 0.0205) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.50% (2.0176 => 2.2900, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4328 => 0.4504, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1041, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.37% (1.3693 => 1.4155, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 3.25% (0.4062 => 0.4194, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1042, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.3899 => 0.4010, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3622, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2389, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.72% (0.7710 => 0.7920, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (0.7038 => 0.7226, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1861, std. dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (1.9828 => 2.0341, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2292 => 1.2604, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (3.8646 => 3.9570, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 2.27% (1.1061 => 1.1312, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5764, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.13% (1.9270 => 1.9680, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4050, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 1.46% (0.7061 => 0.7164, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0260, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7070, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.84% (1.8175 => 2.2508, std. dev.: 0.0611) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.04% (1.2998 => 1.3913, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7233, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5187, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5842, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7152, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1385, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (0.5184 => 0.5296, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.77% (22.5627 => 20.8098, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.21% (0.3511 => 0.3328, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.62% (0.3623 => 0.3492, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -3.44% (0.3663 => 0.3537, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.6576 => 0.6363, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -2.94% (0.3914 => 0.3799, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.82% (33.2944 => 32.6896, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5997, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1137, std. dev.: 0.0250) MultiSource/Applications/spiff/spiff: -2.36% (3.0263 => 2.9549, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9609, std. dev.: 0.0205) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5138, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2353, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2540, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 02:14:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 04:14:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618091443.4B71B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1215?compare_to=1212&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1215, Order: 158654, Start Time: 2012-06-18 08:15:38, End Time: 2012-06-18 09:16:08 To: 1212, Order: 158652, Start Time: 2012-06-18 06:45:24, End Time: 2012-06-18 07:48:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 870 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (10.1189 => 10.3561, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (10.3270 => 10.5633, std. dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -3.24% (22.1641 => 21.4456, std. dev.: 0.0221) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.22% (10.4361 => 10.5633, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.67% (26.0924 => 26.7894, std. dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.93% (0.8651 => 0.7273, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7885, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (2.9384 => 2.6925, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.65% (1.1194 => 1.0450, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (5.3855 => 5.1030, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4340, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.01% (5.3526 => 5.1377, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.01% (6.6874 => 6.4193, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -3.29% (22.1758 => 21.4456, std. dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.57% (2.2022 => 2.1457, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.21% (0.4879 => 0.4771, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.46% (7.0540 => 6.9510, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7406, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (7.9617 => 7.8751, std. dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 03:45:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 05:45:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618104502.5D7022A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1216?compare_to=1214&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1216, Order: 158656, Start Time: 2012-06-18 09:49:47, End Time: 2012-06-18 10:46:26 To: 1214, Order: 158654, Start Time: 2012-06-18 08:11:20, End Time: 2012-06-18 09:08:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (778 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2908, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.25% (0.4328 => 0.4512, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (3.9660 => 4.1034, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 3.39% (1.3693 => 1.4157, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.4062 => 0.4196, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.3899 => 0.4014, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7038 => 0.7238, std. dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 2.82% (16.6129 => 17.0809, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2400, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1827, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.60% (1.9828 => 2.0343, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.60% (1.2292 => 1.2611, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.50% (0.7710 => 0.7903, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (3.8646 => 3.9564, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.1364 => 1.1631, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5778, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4877, std. dev.: 0.0078) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9678, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.3819 => 1.4092, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 1.54% (0.7061 => 0.7170, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0280, std. dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 26.07% (1.8175 => 2.2913, std. dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.26% (2.0200 => 2.1869, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7282, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9222, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5840, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7155, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1186, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.94% (0.4657 => 0.3542, std. dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.70% (22.5627 => 20.8247, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.27% (0.3511 => 0.3326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3623 => 0.3491, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.53% (0.3601 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3663 => 0.3538, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.16% (0.6576 => 0.6368, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.87% (33.2944 => 32.6720, std. dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2124, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5895, std. dev.: 0.0141) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1096, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6995, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9750, std. dev.: 0.0841) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 03:51:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 05:51:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618105106.646DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1217?compare_to=1215&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1217, Order: 158656, Start Time: 2012-06-18 09:51:57, End Time: 2012-06-18 10:52:31 To: 1215, Order: 158654, Start Time: 2012-06-18 08:15:38, End Time: 2012-06-18 09:16:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.20% (10.4361 => 10.5611, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7823, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.95% (0.8651 => 0.7271, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.24% (5.2763 => 4.7890, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.40% (2.9384 => 2.6915, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.66% (1.1194 => 1.0449, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (5.3855 => 5.1023, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4174, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.94% (6.6874 => 6.4238, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.88% (5.3526 => 5.1450, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -3.32% (22.1758 => 21.4388, std. dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.59% (2.2022 => 2.1451, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.17% (0.4879 => 0.4773, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.31% (7.0540 => 6.9617, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.22% (1.7609 => 1.7395, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8797, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 04:43:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 06:43:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618114334.B07D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1218?compare_to=1213&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1218, Order: 158654, Start Time: 2012-06-18 09:29:23, End Time: 2012-06-18 11:44:59 To: 1213, Order: 158652, Start Time: 2012-06-18 06:45:21, End Time: 2012-06-18 09:02:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (3 on baseline) Unchanged Tests: 892 (891 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.55% (0.9708 => 0.9858, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0736 => 2.0973, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.66% (0.9697 => 0.9858, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0673 => 2.0973, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 1.07% (0.9909 => 1.0015, std. dev.: 0.0009) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 07:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 09:25:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618142544.BFD6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1219?compare_to=1218&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1219, Order: 158656, Start Time: 2012-06-18 12:11:44, End Time: 2012-06-18 14:27:11 To: 1218, Order: 158654, Start Time: 2012-06-18 09:29:23, End Time: 2012-06-18 11:44:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.48% (0.9697 => 0.9841, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (2.0673 => 2.0940, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.11% (0.9909 => 1.0019, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.07% (1.9694 => 1.9483, std. dev.: 0.0041) Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 09:21:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 11:21:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618162122.C54C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1220?compare_to=1216&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1220, Order: 158659, Start Time: 2012-06-18 15:25:55, End Time: 2012-06-18 16:22:46 To: 1216, Order: 158656, Start Time: 2012-06-18 09:49:47, End Time: 2012-06-18 10:46:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (765 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.21% (0.4328 => 0.4510, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (3.9660 => 4.1152, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 3.61% (1.3693 => 1.4188, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5265 => 0.5453, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4062 => 0.4206, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3668, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3899 => 0.4023, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2472, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7038 => 0.7251, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8310 => 0.8561, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.02% (0.3580 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.92% (0.3489 => 0.3591, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3485 => 0.3586, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0931, std. dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2167, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.81% (1.2292 => 1.2637, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (1.9828 => 2.0381, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (0.7710 => 0.7921, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (13.2842 => 13.6469, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (3.8646 => 3.9694, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4016 => 0.4122, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.41% (1.9270 => 1.9734, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4076, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (1.3819 => 1.4079, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.48% (14.8535 => 15.0730, std. dev.: 0.0149) MultiSource/Applications/spiff/spiff: 1.40% (0.7506 => 0.7611, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (3.6692 => 3.7159, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.17% (0.8698 => 0.8800, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1465, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6512, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4336, std. dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0482) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.44% (0.9996 => 1.0840, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7302, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.02% (1.9199 => 1.9778, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1510, std. dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7125, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.5184 => 0.5308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.74% (0.4657 => 0.3598, std. dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.5627 => 20.8625, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.30% (0.3511 => 0.3325, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -3.42% (0.3623 => 0.3499, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -2.68% (0.3914 => 0.3809, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4003 => 0.3901, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.59% (33.2944 => 32.7666, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5877, std. dev.: 0.0232) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1133, std. dev.: 0.0410) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9564, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9200, std. dev.: 0.0485) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6992, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2504, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2353, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 09:26:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 11:26:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618162639.764442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1221?compare_to=1217&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1221, Order: 158659, Start Time: 2012-06-18 15:27:47, End Time: 2012-06-18 16:28:05 To: 1217, Order: 158656, Start Time: 2012-06-18 09:51:57, End Time: 2012-06-18 10:52:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 2 (21 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (850 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.54% (10.3513 => 9.8810, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.09% (0.9856 => 0.9749, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.08% (10.4361 => 10.5485, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.66% (26.0924 => 26.7869, std. dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.93% (0.8651 => 0.7273, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.37% (5.2763 => 4.7821, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.55% (2.9384 => 2.6873, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.80% (1.1194 => 1.0433, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.46% (5.3855 => 5.0915, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2962, std. dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (10.3673 => 9.8810, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.14% (5.3526 => 5.1312, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.04% (6.6874 => 6.4172, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -3.52% (22.1758 => 21.3956, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.25% (2.2022 => 2.1306, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.42% (0.4879 => 0.4761, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -2.16% (0.7326 => 0.7168, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.00% (7.0540 => 6.9131, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -1.94% (0.5925 => 0.5810, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (7.9617 => 7.8503, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: -1.29% (1.5603 => 1.5402, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.18% (2.0665 => 2.0421, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -1.18% (1.2842 => 1.2691, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7407, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.1363 => 8.0456, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 10:40:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 12:40:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618174018.4A9C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1222?compare_to=1219&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1222, Order: 158659, Start Time: 2012-06-18 15:25:56, End Time: 2012-06-18 17:41:44 To: 1219, Order: 158656, Start Time: 2012-06-18 12:11:44, End Time: 2012-06-18 14:27:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (0 on baseline) Performance Improvements: 2 (4 on baseline) Unchanged Tests: 891 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.63% (0.2272 => 0.2400, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.31% (0.9841 => 0.9712, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (2.1039 => 2.0742, std. dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.56% (0.4253 => 0.4144, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -1.76% (0.7171 => 0.7045, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.21% (1.9694 => 1.9455, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.09% (1.9966 => 1.9749, std. dev.: 0.0007) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 10:44:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 12:44:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618174435.9BB862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1223?compare_to=1220&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1223, Order: 158661, Start Time: 2012-06-18 16:49:23, End Time: 2012-06-18 17:46:01 To: 1220, Order: 158659, Start Time: 2012-06-18 15:25:55, End Time: 2012-06-18 16:22:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (73 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3598 => 0.3747, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.84% (0.4328 => 0.4494, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.71% (0.6959 => 0.7217, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (3.9660 => 4.1110, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 3.47% (1.3693 => 1.4168, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.20% (0.4062 => 0.4192, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.7710 => 0.7942, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2436, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2148, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.78% (16.6129 => 17.0743, std. dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.59% (0.3899 => 0.4000, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (1.9828 => 2.0309, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.2842 => 13.6059, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (3.8646 => 3.9580, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2292 => 1.2584, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.35% (1.1061 => 1.1321, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.17% (1.9270 => 1.9689, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 1.94% (0.5818 => 0.5931, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 1.81% (0.7061 => 0.7189, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (0.7460 => 0.7591, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.74% (0.5748 => 0.5848, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.69% (1.3819 => 1.4053, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4044, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.49% (0.7506 => 0.7618, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7155, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0381, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.01% (16.2614 => 16.4264, std. dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6421, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0505) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 8.20% (1.2998 => 1.4064, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7330, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5170, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7156, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1390, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2459, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.54% (0.4657 => 0.3747, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9025, std. dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.07% (0.6576 => 0.6374, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.82% (0.3650 => 0.3547, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.73% (33.2944 => 32.7186, std. dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1185, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9470, std. dev.: 0.0715) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7027, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2548, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2386, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 10:53:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 12:53:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618175336.190EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1224?compare_to=1221&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1224, Order: 158661, Start Time: 2012-06-18 16:54:49, End Time: 2012-06-18 17:55:02 To: 1221, Order: 158659, Start Time: 2012-06-18 15:27:47, End Time: 2012-06-18 16:28:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (1 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 870 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.94% (9.8810 => 10.0731, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 1.42% (0.7273 => 0.7376, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -6.76% (21.3956 => 19.9483, std. dev.: 0.0219) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.48% (26.0924 => 26.7387, std. dev.: 0.0297) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.74% (0.8651 => 0.7376, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.04% (22.1758 => 19.9483, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.11% (5.2763 => 4.7957, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.62% (2.9384 => 2.6852, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.42% (1.1194 => 1.0475, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3266, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.71% (5.3855 => 5.1320, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.24% (6.6874 => 6.4036, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.28% (5.3526 => 5.1773, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -2.84% (10.3673 => 10.0731, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.68% (2.2022 => 2.1432, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.68% (7.0540 => 6.9357, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: -1.49% (0.7326 => 0.7217, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (7.9617 => 7.8729, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 12:07:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 14:07:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618190751.C58532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1225?compare_to=1223&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1225, Order: 158665, Start Time: 2012-06-18 18:12:37, End Time: 2012-06-18 19:09:17 To: 1223, Order: 158661, Start Time: 2012-06-18 16:49:23, End Time: 2012-06-18 17:46:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (770 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.21% (2.0176 => 2.3044, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.46% (0.4328 => 0.4521, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.85% (3.9660 => 4.1185, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 3.67% (0.2781 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.63% (0.2945 => 0.3052, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.61% (1.3693 => 1.4188, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4062 => 0.4208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.47% (0.3022 => 0.3127, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5265 => 0.5446, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3580 => 0.3693, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (1.9828 => 2.0445, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3489 => 0.3597, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.04% (0.3485 => 0.3591, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.03% (13.8202 => 14.2390, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.3899 => 0.4014, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.7710 => 0.7935, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 2.90% (0.3453 => 0.3553, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.89% (0.4016 => 0.4132, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.89% (1.2292 => 1.2647, std. dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0925, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2420, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.66% (1.2193 => 1.2517, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.2842 => 13.6236, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4390 => 0.4502, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9630, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.37% (0.5818 => 0.5956, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.32% (1.1061 => 1.1318, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9716, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.21% (0.7061 => 0.7217, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 2.19% (0.5748 => 0.5874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.88% (1.3813 => 1.4073, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3819 => 1.4069, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0470, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (0.8698 => 0.8809, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7138, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6452, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4301, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0532) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.22% (1.2998 => 1.3936, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7265, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5173, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.68% (4.5928 => 4.7160, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1373, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.48% (0.4657 => 0.3750, std. dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9301, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.8818 => 0.8550, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.47% (33.2944 => 32.8046, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5779, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std. dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.22% (0.4867 => 0.4759, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1391, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9526, std. dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2366, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 12:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 14:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618192044.DC7902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1226?compare_to=1224&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1226, Order: 158665, Start Time: 2012-06-18 18:21:43, End Time: 2012-06-18 19:22:10 To: 1224, Order: 158661, Start Time: 2012-06-18 16:54:49, End Time: 2012-06-18 17:55:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 9.88% (0.3817 => 0.4194, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7443, std. dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.70% (0.8651 => 0.7293, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9481, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.03% (5.2763 => 4.7999, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (2.9384 => 2.6955, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (1.1194 => 1.0514, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3637, std. dev.: 0.0286) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (5.3855 => 5.1250, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.08% (6.6874 => 6.4147, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.45% (5.3526 => 5.1678, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -3.03% (10.3673 => 10.0528, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.28% (2.2022 => 2.1519, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.17% (0.4879 => 0.4773, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7326 => 0.7201, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.59% (7.0540 => 6.9421, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (7.9617 => 7.8688, std. dev.: 0.0134) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 13:22:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 15:22:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618202228.E31172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1227?compare_to=1222&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1227, Order: 158665, Start Time: 2012-06-18 18:08:21, End Time: 2012-06-18 20:23:53 To: 1222, Order: 158659, Start Time: 2012-06-18 15:25:56, End Time: 2012-06-18 17:41:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 893 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.91% (2.0742 => 2.1139, std. dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0820 => 2.1139, std. dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.16% (1.9966 => 1.9735, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.04% (1.9694 => 1.9490, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (2.7292 => 2.7017, std. dev.: 0.0050) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 13:31:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 15:31:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618203107.7B54D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1228?compare_to=1225&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1228, Order: 158667, Start Time: 2012-06-18 19:35:54, End Time: 2012-06-18 20:32:32 To: 1225, Order: 158665, Start Time: 2012-06-18 18:12:37, End Time: 2012-06-18 19:09:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (72 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (780 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.24% (1.3078 => 1.3240, std. dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.17% (2.0176 => 2.3035, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4328 => 0.4507, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (3.9660 => 4.1162, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.65% (1.3693 => 1.4193, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.4062 => 0.4201, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.0594 => 1.0949, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3667, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.7710 => 0.7939, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2429, std. dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.87% (0.3899 => 0.4011, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2156, std. dev.: 0.1012) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0824, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (1.9828 => 2.0372, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4016 => 0.4124, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7038 => 0.7224, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2193 => 1.2503, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9628, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.53% (1.2292 => 1.2603, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (13.2842 => 13.6175, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 1.94% (0.5818 => 0.5931, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 1.90% (0.7061 => 0.7195, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.79% (0.5748 => 0.5851, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.3819 => 1.4050, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0666, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7139, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4595, std. dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (6.5754 => 6.6439, std. dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std. dev.: 0.0434) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.24% (2.0200 => 2.1865, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.09% (0.9996 => 1.0805, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7147, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9622, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.94% (7.9275 => 8.1607, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5852, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7149, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.80% (0.4657 => 0.3828, std. dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.5627 => 20.9189, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.32% (0.6576 => 0.6358, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.67% (33.2944 => 32.7369, std. dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.92% (1.3780 => 1.3240, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5735, std. dev.: 0.0301) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1149, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9601, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9771, std. dev.: 0.0519) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8447, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 13:47:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 15:47:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618204753.8AA542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1229?compare_to=1226&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1229, Order: 158670, Start Time: 2012-06-18 19:48:54, End Time: 2012-06-18 20:49:19 To: 1226, Order: 158665, Start Time: 2012-06-18 18:21:43, End Time: 2012-06-18 19:22:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 8.57% (0.3817 => 0.4144, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7686, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout/ary3: 1.05% (3.6994 => 3.7383, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.68% (0.8651 => 0.7381, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9414, std. dev.: 0.0218) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.13% (5.2763 => 4.7948, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.50% (2.9384 => 2.6885, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.46% (1.1194 => 1.0471, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3062, std. dev.: 0.0766) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.81% (5.3855 => 5.1265, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.25% (6.6874 => 6.4034, std. dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: -3.82% (10.3673 => 9.9708, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.35% (5.3526 => 5.1733, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.93% (2.2022 => 2.1376, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.11% (0.4879 => 0.4776, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.77% (7.0540 => 6.9290, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (7.9617 => 7.8572, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 14:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 16:54:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618215428.37D9A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1230?compare_to=1228&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1230, Order: 158677, Start Time: 2012-06-18 20:59:11, End Time: 2012-06-18 21:55:53 To: 1228, Order: 158667, Start Time: 2012-06-18 19:35:54, End Time: 2012-06-18 20:32:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.53% (2.0176 => 2.2905, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.16% (0.4328 => 0.4508, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.86% (1.3693 => 1.4221, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.71% (0.6959 => 0.7217, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (3.9660 => 4.1077, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4062 => 0.4204, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.23% (0.3899 => 0.4025, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.01% (16.6129 => 17.1123, std. dev.: 0.0172) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2439, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7038 => 0.7240, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3580 => 0.3682, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.2292 => 1.2636, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.79% (0.7710 => 0.7925, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (1.9828 => 2.0370, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.70% (13.8202 => 14.1935, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.4016 => 0.4121, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (3.8646 => 3.9648, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5769, std. dev.: 0.0241) MultiSource/Applications/treecc/treecc: 2.15% (1.9270 => 1.9684, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 2.05% (0.5818 => 0.5937, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 1.84% (0.7061 => 0.7191, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4048, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4040, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.8698 => 0.8815, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0241, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (3.6692 => 3.7108, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.00% (1.8175 => 2.2719, std. dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 8.20% (1.2998 => 1.4064, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7272, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5837, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.59% (4.5928 => 4.7119, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1325, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9526, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.5627 => 20.8634, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.21% (0.3511 => 0.3328, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.36% (0.6576 => 0.6355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.24% (0.8818 => 0.8532, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3623 => 0.3507, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -2.97% (0.3601 => 0.3494, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.96% (0.3578 => 0.3472, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -2.84% (0.3663 => 0.3559, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -2.80% (0.3646 => 0.3544, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.70% (33.2944 => 32.7298, std. dev.: 0.0266) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3122, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5515, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5945, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1108, std. dev.: 0.0498) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9171, std. dev.: 0.0386) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2381, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 15:15:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 17:15:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618221504.067732A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1231?compare_to=1229&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1231, Order: 158677, Start Time: 2012-06-18 21:16:04, End Time: 2012-06-18 22:16:29 To: 1229, Order: 158670, Start Time: 2012-06-18 19:48:54, End Time: 2012-06-18 20:49:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (1 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (9.9708 => 10.2425, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7508, std. dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.87% (0.8651 => 0.7365, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -9.96% (22.1758 => 19.9668, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.99% (5.2763 => 4.8021, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.48% (2.9384 => 2.6892, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.38% (1.1194 => 1.0480, std. dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3399, std. dev.: 0.0607) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.74% (5.3855 => 5.1301, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.39% (6.6874 => 6.3939, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.25% (5.3526 => 5.1787, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.36% (2.2022 => 2.1502, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.11% (0.4879 => 0.4776, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.55% (7.0540 => 6.9445, std. dev.: 0.0204) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (10.3673 => 10.2425, std. dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (7.9617 => 7.8765, std. dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 16:04:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 18:04:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120618230431.5B31F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1232?compare_to=1227&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1232, Order: 158676, Start Time: 2012-06-18 20:50:32, End Time: 2012-06-18 23:05:57 To: 1227, Order: 158665, Start Time: 2012-06-18 18:08:21, End Time: 2012-06-18 20:23:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 891 (888 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.48% (0.9740 => 0.9884, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.2269 => 0.2402, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.51% (2.1139 => 2.0819, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.93% (0.9697 => 0.9884, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.23% (2.0673 => 2.0928, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.12% (0.9909 => 1.0020, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.63% (2.4764 => 2.4113, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.4253 => 0.4147, std. dev.: 0.0013) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 16:17:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 18:17:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120618231744.B2DC82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1233?compare_to=1230&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1233, Order: 158682, Start Time: 2012-06-18 22:22:35, End Time: 2012-06-18 23:19:08 To: 1230, Order: 158677, Start Time: 2012-06-18 20:59:11, End Time: 2012-06-18 21:55:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (76 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (766 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.79% (3.7610 => 3.8659, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.83% (0.3996 => 0.3723, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.44% (2.0176 => 2.2887, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.27% (0.4328 => 0.4513, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.72% (0.4062 => 0.4213, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.67% (0.2781 => 0.2883, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.64% (1.3693 => 1.4192, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.6959 => 0.7208, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1061, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3899 => 0.4030, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3149 => 0.3249, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3485 => 0.3593, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1179, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (1.9828 => 2.0425, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.3245 => 1.3637, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3580 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.89% (0.3489 => 0.3590, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.83% (2.1791 => 2.2408, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.7710 => 0.7927, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.2292 => 1.2636, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4016 => 0.4125, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (0.7038 => 0.7229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1640, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (3.8646 => 3.9553, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.31% (1.1061 => 1.1317, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.23% (1.2193 => 1.2465, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.1364 => 1.1616, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 2.10% (0.5818 => 0.5940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.04% (0.5748 => 0.5865, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5445, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 1.93% (0.7061 => 0.7197, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4839, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4020, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.8698 => 0.8808, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.22% (1.2998 => 1.3936, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7320, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7165, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1308, std. dev.: 0.0174) MultiSource/Benchmarks/llubenchmark/llu: 2.46% (3.7731 => 3.8659, std. dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.06% (0.4657 => 0.3723, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.77% (22.5627 => 20.8105, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (0.8818 => 0.8503, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.37% (0.3623 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.30% (0.3663 => 0.3542, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.19% (0.6576 => 0.6366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.97% (0.3940 => 0.3823, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.95% (0.9108 => 0.8930, std. dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -1.80% (33.2944 => 32.6959, std. dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2138, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5939, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9566, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8869, std. dev.: 0.0663) MultiSource/Applications/minisat/minisat: -2.18% (9.3358 => 9.1320, std. dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4867 => 0.4761, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6988, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2507, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.5254 => 2.4863, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2351, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.22% (0.9692 => 0.9574, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 16:42:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 18:42:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120618234215.6E4192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1234?compare_to=1231&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1234, Order: 158682, Start Time: 2012-06-18 22:43:26, End Time: 2012-06-18 23:43:40 To: 1231, Order: 158677, Start Time: 2012-06-18 21:16:04, End Time: 2012-06-18 22:16:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (10.2425 => 10.3708, std. dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.13% (0.3817 => 0.4242, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.51% (26.0924 => 26.7463, std. dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.99% (0.8651 => 0.7354, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9458, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.21% (5.2763 => 4.7904, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.72% (2.9384 => 2.6821, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.64% (1.1194 => 1.0451, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3625, std. dev.: 0.0254) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.07% (5.3855 => 5.1125, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.63% (6.6874 => 6.3778, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.55% (5.3526 => 5.1628, std. dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.05% (2.2022 => 2.1351, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.89% (7.0540 => 6.9210, std. dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (7.9617 => 7.8502, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7412, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 17:41:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 19:41:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619004105.088BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1235?compare_to=1233&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1235, Order: 158687, Start Time: 2012-06-18 23:45:52, End Time: 2012-06-19 00:42:29 To: 1233, Order: 158682, Start Time: 2012-06-18 22:22:35, End Time: 2012-06-18 23:19:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.08% (32.6959 => 33.0491, std. dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4328 => 0.4542, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2726 => 0.2841, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.21% (0.2781 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.06% (0.3149 => 0.3277, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3107 => 0.3231, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.90% (0.3022 => 0.3140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.88% (0.2655 => 0.2758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2607 => 0.2708, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 3.84% (0.2760 => 0.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2765 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.83% (0.2690 => 0.2793, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.75% (1.3693 => 1.4207, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.74% (0.3899 => 0.4045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2966 => 0.3076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.69% (0.2761 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3453 => 0.3580, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (1.9828 => 2.0551, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3485 => 0.3609, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1066, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3489 => 0.3610, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4016 => 0.4155, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.44% (0.3580 => 0.3703, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2708, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3192 => 0.3299, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3868 => 0.3990, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.0594 => 1.0926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1277, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3293 => 0.3395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.3245 => 1.3651, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists1: 3.00% (0.3534 => 0.3640, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.3756 => 0.3868, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4390 => 0.4517, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.83% (2.1791 => 2.2407, std. dev.: 0.0207) MultiSource/Applications/lambda-0_1_3/lambda: 2.76% (0.7038 => 0.7232, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1801, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.52% (1.9270 => 1.9756, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.7710 => 0.7898, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.37% (0.5818 => 0.5956, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.37% (0.7061 => 0.7228, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1364 => 1.1632, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9551, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 2.23% (0.5748 => 0.5876, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5759, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4843, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (0.8698 => 0.8855, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.69% (1.3819 => 1.4053, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0437, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7077, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2730, std. dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4011, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7174, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5190, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5867, std. dev.: 0.0326) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1478, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7132, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.16% (0.4657 => 0.3718, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.5627 => 20.8527, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.8818 => 0.8510, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.14% (0.3601 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.04% (0.3646 => 0.3535, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3663 => 0.3552, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.6576 => 0.6382, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: -2.82% (0.3789 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4112, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5960, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1148, std. dev.: 0.0102) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9217, std. dev.: 0.0921) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6965, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2406, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 18:09:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 20:09:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619010939.12B552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1236?compare_to=1234&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1236, Order: 158688, Start Time: 2012-06-19 00:10:43, End Time: 2012-06-19 01:11:03 To: 1234, Order: 158682, Start Time: 2012-06-18 22:43:26, End Time: 2012-06-18 23:43:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (1 on baseline) Performance Improvements: 2 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 868 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 7.32% (19.9458 => 21.4068, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0467 => 2.0804, std. dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 1.17% (1.2735 => 1.2884, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (10.3708 => 10.1612, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: -1.14% (10.4542 => 10.3348, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7548, std. dev.: 0.0304) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.17% (0.8651 => 0.7252, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.47% (5.2763 => 4.7768, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.66% (2.9384 => 2.6839, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.76% (1.1194 => 1.0437, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.33% (5.3855 => 5.0983, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2847, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.18% (6.6874 => 6.4079, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.06% (5.3526 => 5.1355, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -3.47% (22.1758 => 21.4068, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.05% (2.2022 => 2.1351, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.05% (0.4879 => 0.4779, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (10.3673 => 10.1612, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.78% (7.0540 => 6.9285, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.11% (1.7609 => 1.7413, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 18:46:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 20:46:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619014636.27CE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1237?compare_to=1232&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1237, Order: 158686, Start Time: 2012-06-18 23:32:35, End Time: 2012-06-19 01:48:02 To: 1232, Order: 158676, Start Time: 2012-06-18 20:50:32, End Time: 2012-06-18 23:05:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 893 (888 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.06% (17.2997 => 17.1163, std. dev.: 0.0647) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.66% (0.3792 => 0.4386, std. dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (2.0673 => 2.1075, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.6435 => 0.6535, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.30% (23.5202 => 23.8256, std. dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.84% (2.4764 => 2.4060, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.4253 => 0.4149, std. dev.: 0.0010) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 19:04:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 21:04:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619020436.17C742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1238?compare_to=1235&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1238, Order: 158691, Start Time: 2012-06-19 01:09:17, End Time: 2012-06-19 02:06:01 To: 1235, Order: 158687, Start Time: 2012-06-18 23:45:52, End Time: 2012-06-19 00:42:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (755 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2953, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2760 => 0.2885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.50% (0.3022 => 0.3158, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.35% (0.2966 => 0.3095, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.23% (1.9828 => 2.0666, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.15% (0.3899 => 0.4061, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3485 => 0.3628, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3580 => 0.3725, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3192 => 0.3318, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.91% (1.3693 => 1.4229, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2292 => 1.2763, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2988 => 0.3099, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3293 => 0.3408, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1041, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (0.3756 => 0.3886, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3534 => 0.3656, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.5818 => 0.6013, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 3.27% (0.5748 => 0.5936, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.14% (0.7061 => 0.7283, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.11% (16.6129 => 17.1301, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2387, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.63% (13.8202 => 14.1834, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.57% (0.7710 => 0.7908, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7038 => 0.7218, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5824, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9487, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.16% (1.9270 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.79% (1.3819 => 1.4067, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 27.01% (1.8175 => 2.3084, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1881, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4072, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7475, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.85% (7.9275 => 8.1533, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7143, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5070, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.35% (10.7476 => 10.8929, std. dev.: 0.0484) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.2308 => 1.2436, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.01% (0.4657 => 0.3725, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.5627 => 20.9168, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.87% (0.8818 => 0.8477, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.22% (0.6576 => 0.6364, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -2.76% (0.3623 => 0.3523, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.05% (0.9108 => 0.8921, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (6.2785 => 6.2153, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6010, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1111, std. dev.: 0.0321) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9141, std. dev.: 0.0347) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7017, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2502, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2385, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 19:36:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 21:36:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619023641.0B4F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1239?compare_to=1236&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1239, Order: 158692, Start Time: 2012-06-19 01:37:47, End Time: 2012-06-19 02:38:06 To: 1236, Order: 158688, Start Time: 2012-06-19 00:10:43, End Time: 2012-06-19 01:11:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (2 on baseline) Performance Improvements: 1 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (859 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.47% (10.1612 => 10.5135, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 1.59% (10.3348 => 10.4988, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.15% (5.1355 => 5.1947, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -11.36% (21.4068 => 18.9753, std. dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (10.3673 => 10.5135, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.60% (26.0924 => 26.7713, std. dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.01% (0.8651 => 0.7266, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -14.43% (22.1758 => 18.9753, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.36% (5.2763 => 4.7826, std. dev.: 0.0310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.97% (2.9384 => 2.6747, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.11% (1.1194 => 1.0398, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3903, std. dev.: 0.0187) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.51% (5.3855 => 5.1424, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.41% (6.6874 => 6.3923, std. dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.12% (2.2022 => 2.1336, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.95% (5.3526 => 5.1947, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.05% (0.4879 => 0.4779, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.59% (7.0540 => 6.9415, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 20:27:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 22:27:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619032747.5D1D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1240?compare_to=1238&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1240, Order: 158695, Start Time: 2012-06-19 02:32:40, End Time: 2012-06-19 03:29:13 To: 1238, Order: 158691, Start Time: 2012-06-19 01:09:17, End Time: 2012-06-19 02:06:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 3 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (749 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.90% (0.5936 => 0.5823, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.68% (0.6013 => 0.5912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.47% (0.7283 => 0.7176, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.76% (2.0176 => 2.2750, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.63% (0.2937 => 0.3073, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.45% (0.2966 => 0.3098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.44% (0.2655 => 0.2773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2690 => 0.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 4.26% (1.3693 => 1.4277, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.22% (0.3107 => 0.3238, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (1.9828 => 2.0663, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.3489 => 0.3629, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3580 => 0.3722, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4016 => 0.4167, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 3.72% (1.2292 => 1.2749, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.34% (0.3293 => 0.3403, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.4390 => 0.4527, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9199 => 0.9484, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0885, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.76% (0.7038 => 0.7232, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.73% (16.6129 => 17.0658, std. dev.: 0.0192) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1736, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.3245 => 1.3580, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.2193 => 1.2464, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (3.8646 => 3.9444, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5548, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.89% (1.9270 => 1.9634, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4810, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 1.63% (0.7061 => 0.7176, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4003, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2675, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1905, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 8.37% (1.2998 => 1.4086, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7390, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5861, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7153, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1371, std. dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.55% (0.4657 => 0.3700, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8744, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.55% (0.3511 => 0.3281, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.8818 => 0.8501, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.54% (0.6576 => 0.6343, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.31% (0.9108 => 0.8898, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (6.2785 => 6.2094, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5939, std. dev.: 0.0094) MultiSource/Applications/minisat/minisat: -2.34% (9.3358 => 9.1169, std. dev.: 0.0215) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.30% (20.3410 => 19.8737, std. dev.: 0.0377) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9594, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2596, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std. dev.: 0.0242) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2548, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 21:03:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 23:03:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619040353.A2E202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1241?compare_to=1239&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1241, Order: 158697, Start Time: 2012-06-19 03:04:47, End Time: 2012-06-19 04:05:17 To: 1239, Order: 158692, Start Time: 2012-06-19 01:37:47, End Time: 2012-06-19 02:38:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 2 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 12.75% (18.9753 => 21.3947, std. dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (10.5135 => 10.7510, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.29% (10.4988 => 10.3630, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.26% (5.1947 => 5.1291, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.70% (10.3673 => 10.7510, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.60% (26.0924 => 26.7697, std. dev.: 0.0323) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.93% (0.8651 => 0.7273, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.59% (5.2763 => 4.7704, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.70% (2.9384 => 2.6829, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.07% (1.1194 => 1.0403, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (5.3855 => 5.0934, std. dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4308, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.18% (5.3526 => 5.1291, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.87% (6.6874 => 6.4288, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -3.52% (22.1758 => 21.3947, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.06% (2.2022 => 2.1348, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.13% (0.4879 => 0.4775, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.68% (1.7609 => 1.7314, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.60% (7.0540 => 6.9413, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 21:28:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 23:28:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619042854.C00852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1242?compare_to=1237&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1242, Order: 158694, Start Time: 2012-06-19 02:14:54, End Time: 2012-06-19 04:30:19 To: 1237, Order: 158686, Start Time: 2012-06-18 23:32:35, End Time: 2012-06-19 01:48:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Unchanged Tests: 893 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.11% (17.1163 => 17.3069, std. dev.: 0.0574) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 2.06% (23.5202 => 24.0053, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (2.0673 => 2.1096, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.85% (0.9909 => 1.0092, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.6435 => 0.6547, std. dev.: 0.0014) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 21:51:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 18 Jun 2012 23:51:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619045103.6415A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1243?compare_to=1240&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1243, Order: 158699, Start Time: 2012-06-19 03:55:53, End Time: 2012-06-19 04:52:28 To: 1240, Order: 158695, Start Time: 2012-06-19 02:32:40, End Time: 2012-06-19 03:29:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.05% (1.4277 => 1.4427, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.36% (1.3693 => 1.4427, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2655 => 0.2785, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.79% (1.9828 => 2.0777, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.36% (1.2292 => 1.2828, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.22% (0.2988 => 0.3114, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.11% (0.4016 => 0.4181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.06% (0.3868 => 0.4025, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (3.9660 => 4.1118, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5265 => 0.5453, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3679, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 3.25% (0.7038 => 0.7267, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 3.23% (16.6129 => 17.1489, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.00% (2.1791 => 2.2444, std. dev.: 0.0155) MultiSource/Applications/SPASS/SPASS: 2.80% (13.8202 => 14.2067, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.7710 => 0.7922, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3755 => 0.3855, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.2193 => 1.2516, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (3.8646 => 3.9642, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6017, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.34% (1.9270 => 1.9721, std. dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference-object: 2.34% (0.5818 => 0.5954, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.29% (0.7061 => 0.7223, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.8698 => 0.8891, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.11% (0.5748 => 0.5869, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4060, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.3813 => 1.4042, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.51% (0.7506 => 0.7619, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0671, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (3.6692 => 3.7105, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9996 => 1.0808, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7149, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5169, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1427, std. dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.2308 => 1.2457, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.15% (0.4657 => 0.3765, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9450, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.50% (1.9762 => 1.9070, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6031, std. dev.: 0.0086) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1106, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5011, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9807, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2411, std. dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 22:31:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 00:31:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619053112.B786D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1244?compare_to=1241&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1244, Order: 158702, Start Time: 2012-06-19 04:32:20, End Time: 2012-06-19 05:32:38 To: 1241, Order: 158697, Start Time: 2012-06-19 03:04:47, End Time: 2012-06-19 04:05:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (2 on baseline) Performance Improvements: 2 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 868 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (5.1291 => 5.2017, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (5.0934 => 5.1509, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (10.3630 => 10.4700, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -11.21% (21.3947 => 18.9968, std. dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -2.59% (10.7510 => 10.4730, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (10.3673 => 10.4730, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.51% (26.0924 => 26.7468, std. dev.: 0.0311) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.25% (0.8651 => 0.7332, std. dev.: 0.0294) MultiSource/Applications/ClamAV/clamscan: -14.34% (22.1758 => 18.9968, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.16% (5.2763 => 4.7931, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.42% (2.9384 => 2.6911, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (1.1194 => 1.0423, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4444, std. dev.: 0.0375) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.38% (6.6874 => 6.3945, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.36% (5.3855 => 5.1509, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.19% (2.2022 => 2.1320, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.82% (5.3526 => 5.2017, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.17% (0.4879 => 0.4773, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.80% (7.0540 => 6.9270, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.27% (1.7609 => 1.7385, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 23:14:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 01:14:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619061424.1AAB72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1245?compare_to=1243&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1245, Order: 158702, Start Time: 2012-06-19 05:19:07, End Time: 2012-06-19 06:15:50 To: 1243, Order: 158699, Start Time: 2012-06-19 03:55:53, End Time: 2012-06-19 04:52:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2761, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.74% (1.9828 => 2.0966, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.68% (0.2696 => 0.2849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2292 => 1.2887, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4390 => 0.4589, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.76% (0.5818 => 0.6037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.70% (0.7061 => 0.7322, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 3.57% (16.6129 => 17.2067, std. dev.: 0.0111) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5748 => 0.5950, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (3.9660 => 4.1051, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.42% (0.5265 => 0.5445, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7038 => 0.7271, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3667, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2435, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.7710 => 0.7932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2005, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.8698 => 0.8936, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (13.2842 => 13.6398, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (3.8646 => 3.9597, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.40% (1.9270 => 1.9732, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1326, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.4563 => 1.4869, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.65% (1.3813 => 1.4041, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.52% (0.7506 => 0.7620, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0394, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7100, std. dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2890, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1880, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4067, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7412, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5188, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1507, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.71% (4.5928 => 4.7171, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.78% (0.4657 => 0.3736, std. dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9613, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.58% (0.3511 => 0.3280, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.6576 => 0.6369, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5875, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1148, std. dev.: 0.0385) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9558, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.33% (20.3410 => 19.8677, std. dev.: 0.0716) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5096, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7020, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2343, std. dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.12% (0.9692 => 0.9583, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 18 23:58:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 01:58:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619065812.65B7A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1246?compare_to=1244&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1246, Order: 158703, Start Time: 2012-06-19 05:59:17, End Time: 2012-06-19 06:59:38 To: 1244, Order: 158702, Start Time: 2012-06-19 04:32:20, End Time: 2012-06-19 05:32:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (1 on baseline) Performance Improvements: 3 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (859 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 12.77% (18.9968 => 21.4220, std. dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.31% (10.4700 => 10.3328, std. dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (10.4730 => 10.3539, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.13% (5.2017 => 5.1431, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7802, std. dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.52% (0.8651 => 0.7308, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.26% (5.2763 => 4.7878, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.41% (2.9384 => 2.6914, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.87% (1.1194 => 1.0425, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (5.3855 => 5.1078, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4926, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.08% (6.6874 => 6.4144, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.91% (5.3526 => 5.1431, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -3.40% (22.1758 => 21.4220, std. dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.30% (2.2022 => 2.1295, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.21% (0.4879 => 0.4771, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.67% (7.0540 => 6.9364, std. dev.: 0.0209) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.26% (1.7609 => 1.7388, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 00:13:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 02:13:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619071340.73A172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1247?compare_to=1242&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1247, Order: 158702, Start Time: 2012-06-19 04:56:54, End Time: 2012-06-19 07:15:06 To: 1242, Order: 158694, Start Time: 2012-06-19 02:14:54, End Time: 2012-06-19 04:30:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (12 on baseline) Unchanged Tests: 894 (882 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3267 => 0.3371, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.13% (0.3258 => 0.3360, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.04% (0.3317 => 0.3418, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.82% (0.3726 => 0.3831, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4251 => 0.4366, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.65% (0.9909 => 1.0172, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.4146 => 0.4254, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.06% (23.5202 => 24.0054, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.6435 => 0.6550, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.66% (0.9697 => 0.9858, std. dev.: 0.0007) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 00:40:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 02:40:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619074039.90A602A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1248?compare_to=1245&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1248, Order: 158704, Start Time: 2012-06-19 06:42:31, End Time: 2012-06-19 07:42:04 To: 1245, Order: 158702, Start Time: 2012-06-19 05:19:07, End Time: 2012-06-19 06:15:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (772 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.34% (2.0176 => 2.2867, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0922, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.14% (1.3693 => 1.4397, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3580 => 0.3757, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2896, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.6959 => 0.7211, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.56% (16.6129 => 17.2041, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1069, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference-object: 3.49% (0.5818 => 0.6021, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.35% (0.7038 => 0.7274, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2496, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2034, std. dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.55% (0.8698 => 0.8920, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (13.2842 => 13.6047, std. dev.: 0.0173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.37% (1.1061 => 1.1323, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9552, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9712, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.4563 => 1.4879, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4048, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4025, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0419, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7091, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 27.57% (1.8175 => 2.3185, std. dev.: 0.0290) SingleSource/Benchmarks/Misc/mandel-2: 8.62% (1.2998 => 1.4118, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7378, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.1105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5847, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.59% (4.5928 => 4.7119, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1270, std. dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9563, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.39% (0.6576 => 0.6353, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -3.33% (0.3578 => 0.3459, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0126) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.82% (20.3410 => 19.7683, std. dev.: 0.1274) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1097, std. dev.: 0.0302) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9570, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7014, std. dev.: 0.0591) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2540, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 01:29:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 03:29:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619082944.3DC802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1249?compare_to=1246&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1249, Order: 158704, Start Time: 2012-06-19 07:30:27, End Time: 2012-06-19 08:31:09 To: 1246, Order: 158703, Start Time: 2012-06-19 05:59:17, End Time: 2012-06-19 06:59:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7519, std. dev.: 0.0233) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.55% (0.8651 => 0.7306, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7881, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.34% (2.9384 => 2.6933, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (1.1194 => 1.0418, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (5.3855 => 5.1086, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4620, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.17% (6.6874 => 6.4085, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.85% (5.3526 => 5.1463, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -3.44% (22.1758 => 21.4120, std. dev.: 0.0396) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.21% (2.2022 => 2.1314, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.28% (0.4879 => 0.4768, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.73% (7.0540 => 6.9323, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.14% (1.7609 => 1.7408, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8795, std. dev.: 0.0173) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (10.4361 => 10.3292, std. dev.: 0.0273) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 02:55:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 04:55:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619095553.1CA242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1250?compare_to=1247&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1250, Order: 158704, Start Time: 2012-06-19 07:41:50, End Time: 2012-06-19 09:57:19 To: 1247, Order: 158702, Start Time: 2012-06-19 04:56:54, End Time: 2012-06-19 07:15:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 892 (888 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.12% (0.2271 => 0.2410, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.14% (1.6085 => 1.5901, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 2.45% (2.0673 => 2.1179, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.05% (0.9909 => 1.0112, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.52% (23.5202 => 23.8766, std. dev.: 0.0090) MultiSource/Applications/hbd/hbd: 1.10% (0.9697 => 0.9804, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.2122 => 0.2266, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.40% (2.4764 => 2.4417, std. dev.: 0.0095) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 03:51:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 05:51:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619105159.BF5682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1251?compare_to=1248&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1251, Order: 158711, Start Time: 2012-06-19 09:56:42, End Time: 2012-06-19 10:53:25 To: 1248, Order: 158704, Start Time: 2012-06-19 06:42:31, End Time: 2012-06-19 07:42:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7514 => 3.7126, std. dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.39% (2.0176 => 2.2877, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.59% (0.3149 => 0.3325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0912, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.27% (0.3453 => 0.3635, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.23% (1.2292 => 1.2935, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 5.22% (1.3693 => 1.4408, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.33% (0.4390 => 0.4580, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1078, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 3.52% (16.6129 => 17.1971, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5265 => 0.5446, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 3.44% (0.5818 => 0.6018, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 3.34% (0.7061 => 0.7297, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.17% (0.5748 => 0.5930, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2446, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.7710 => 0.7928, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.78% (13.8202 => 14.2043, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.68% (0.8698 => 0.8931, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (3.8646 => 3.9634, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.48% (1.1061 => 1.1335, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6083, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.32% (1.9270 => 1.9717, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.3819 => 1.4044, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.41% (0.7506 => 0.7612, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0542, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7065, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.00% (2.1007 => 2.1218, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std. dev.: 0.0427) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9996 => 1.0795, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.65% (1.2998 => 1.3992, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.76% (1.9144 => 1.9863, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1566, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7143, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9569, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9791, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.72% (0.3511 => 0.3275, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.44% (0.3601 => 0.3477, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.30% (0.6576 => 0.6359, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.23% (0.3650 => 0.3532, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5996, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (20.3410 => 19.8409, std. dev.: 0.0869) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1115, std. dev.: 0.0085) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4972, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6974, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2616, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2372, std. dev.: 0.0208) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 04:00:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 06:00:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619110005.219812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1252?compare_to=1249&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1252, Order: 158714, Start Time: 2012-06-19 10:00:48, End Time: 2012-06-19 11:01:32 To: 1249, Order: 158704, Start Time: 2012-06-19 07:30:27, End Time: 2012-06-19 08:31:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7846, std. dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.55% (0.8651 => 0.7306, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7869, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.38% (2.9384 => 2.6921, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.90% (1.1194 => 1.0422, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (5.3855 => 5.1071, std. dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4791, std. dev.: 0.0367) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.15% (6.6874 => 6.4099, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.81% (5.3526 => 5.1486, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -3.43% (22.1758 => 21.4147, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.22% (2.2022 => 2.1312, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.80% (7.0540 => 6.9270, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (1.7609 => 1.7396, std. dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (7.9617 => 7.8788, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -1.01% (10.4361 => 10.3312, std. dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 05:15:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 07:15:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619121515.98F272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1253?compare_to=1251&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1253, Order: 158715, Start Time: 2012-06-19 11:20:06, End Time: 2012-06-19 12:16:42 To: 1251, Order: 158711, Start Time: 2012-06-19 09:56:42, End Time: 2012-06-19 10:53:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (743 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3543 => 0.3661, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.25% (3.8091 => 3.7613, std. dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (2.0176 => 2.2870, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.55% (1.9828 => 2.0929, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.30% (1.3693 => 1.4419, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3580 => 0.3759, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.88% (1.2292 => 1.2892, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4390 => 0.4579, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.64% (1.0594 => 1.0980, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1068, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.44% (16.6129 => 17.1848, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9199 => 0.9515, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.35% (0.7038 => 0.7274, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.30% (0.7061 => 0.7294, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.18% (0.5748 => 0.5931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2435, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1944, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.59% (0.8698 => 0.8923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.7710 => 0.7907, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9629, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6036, std. dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.4563 => 1.4901, std. dev.: 0.0092) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9711, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4042, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0452, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7084, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.17% (1.8175 => 2.2931, std. dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0135) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.79% (7.4271 => 7.7083, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5162, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0366) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.70% (7.9275 => 8.1415, std. dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7140, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (0.5184 => 0.5309, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.39% (0.4657 => 0.3661, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9564, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.72% (0.3511 => 0.3275, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3650 => 0.3525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.42% (0.3623 => 0.3499, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.32% (0.6576 => 0.6358, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.22% (0.3663 => 0.3545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -2.97% (0.3940 => 0.3823, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4003 => 0.3898, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6054, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.22% (9.3358 => 9.1290, std. dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9161, std. dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2354, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 05:27:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 07:27:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619122717.23A3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1254?compare_to=1252&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1254, Order: 158715, Start Time: 2012-06-19 11:28:13, End Time: 2012-06-19 12:28:43 To: 1252, Order: 158714, Start Time: 2012-06-19 10:00:48, End Time: 2012-06-19 11:01:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7460, std. dev.: 0.0273) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.50% (0.8651 => 0.7310, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.27% (5.2763 => 4.7871, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.33% (2.9384 => 2.6936, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (1.1194 => 1.0427, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (5.3855 => 5.1082, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4952, std. dev.: 0.0348) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.17% (6.6874 => 6.4084, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.82% (5.3526 => 5.1481, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -3.38% (22.1758 => 21.4254, std. dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.28% (2.2022 => 2.1300, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.15% (0.4879 => 0.4774, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.80% (7.0540 => 6.9270, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (1.7609 => 1.7397, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (7.9617 => 7.8773, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 05:37:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 07:37:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619123750.B779D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1255?compare_to=1250&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1255, Order: 158715, Start Time: 2012-06-19 10:23:54, End Time: 2012-06-19 12:39:17 To: 1250, Order: 158704, Start Time: 2012-06-19 07:41:50, End Time: 2012-06-19 09:57:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (887 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.11% (0.3539 => 0.4286, std. dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 13.03% (0.3792 => 0.4286, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0673 => 2.1182, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.01% (0.9909 => 1.0108, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.51% (23.5202 => 23.8762, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 1.15% (0.9697 => 0.9809, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.80% (2.4764 => 2.3823, std. dev.: 0.0263) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 08:04:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 10:04:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619150444.DE3492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1256?compare_to=1253&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1256, Order: 158716, Start Time: 2012-06-19 14:09:26, End Time: 2012-06-19 15:06:11 To: 1253, Order: 158715, Start Time: 2012-06-19 11:20:06, End Time: 2012-06-19 12:16:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.42% (2.0176 => 2.2884, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.15% (0.2945 => 0.3126, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.59% (0.3149 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0933, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.35% (1.3693 => 1.4426, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.97% (1.2292 => 1.2903, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4390 => 0.4583, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.71% (0.6959 => 0.7217, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 3.69% (16.6129 => 17.2255, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1087, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 3.52% (0.5818 => 0.6023, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 3.36% (0.7061 => 0.7298, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7038 => 0.7271, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.29% (0.5748 => 0.5937, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0594 => 1.0928, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3655, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.08% (2.1791 => 2.2462, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.7710 => 0.7939, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2253, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.8698 => 0.8924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2501, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9618, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.6000, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4877, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.39% (0.7506 => 0.7610, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0447, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (3.6692 => 3.7107, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1230, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.2749 => 1.2880, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1887, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7292, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.76% (12.4560 => 12.9242, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1420, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7165, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9713, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.35% (0.6576 => 0.6356, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.25% (0.3663 => 0.3544, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.01% (0.3789 => 0.3675, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5936, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1180, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9196, std. dev.: 0.0295) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5141, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2572, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2400, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 08:11:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 10:11:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619151145.5BA972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1257?compare_to=1254&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1257, Order: 158716, Start Time: 2012-06-19 14:12:40, End Time: 2012-06-19 15:13:12 To: 1254, Order: 158715, Start Time: 2012-06-19 11:28:13, End Time: 2012-06-19 12:28:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (2.0665 => 2.0921, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.46% (26.0924 => 26.7336, std. dev.: 0.0409) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.52% (0.8651 => 0.7308, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.30% (5.2763 => 4.7856, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.42% (2.9384 => 2.6910, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.90% (1.1194 => 1.0422, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.12% (5.3855 => 5.1099, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4196, std. dev.: 0.0287) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.16% (6.6874 => 6.4091, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.81% (5.3526 => 5.1486, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -3.44% (22.1758 => 21.4131, std. dev.: 0.0215) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.26% (2.2022 => 2.1305, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.28% (0.4879 => 0.4768, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.67% (7.0540 => 6.9363, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (1.7609 => 1.7396, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8795, std. dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 09:23:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 11:23:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619162328.7A15B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1258?compare_to=1255&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1258, Order: 158716, Start Time: 2012-06-19 14:09:21, End Time: 2012-06-19 16:24:55 To: 1255, Order: 158715, Start Time: 2012-06-19 10:23:54, End Time: 2012-06-19 12:39:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.41% (2.3823 => 2.4396, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (2.0673 => 2.1169, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.17% (0.9909 => 1.0124, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 1.63% (23.5202 => 23.9031, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 1.48% (0.9697 => 0.9841, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.49% (2.4764 => 2.4396, std. dev.: 0.0074) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 09:28:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 11:28:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619162810.85C592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1259?compare_to=1256&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1259, Order: 158719, Start Time: 2012-06-19 15:32:52, End Time: 2012-06-19 16:29:36 To: 1256, Order: 158716, Start Time: 2012-06-19 14:09:26, End Time: 2012-06-19 15:06:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (100 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.20% (1.4033 => 1.4202, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.28% (2.0176 => 2.2855, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4328 => 0.4582, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4062 => 0.4280, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2655 => 0.2784, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.64% (1.9828 => 2.0748, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.54% (1.3693 => 1.4314, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.53% (0.2696 => 0.2818, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.3192 => 0.3327, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.21% (0.3489 => 0.3636, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3485 => 0.3628, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.02% (1.2292 => 1.2786, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.55% (0.4390 => 0.4546, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (3.9660 => 4.1015, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.32% (0.9199 => 0.9504, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.13% (0.7038 => 0.7258, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 3.00% (16.6129 => 17.1121, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0113) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2402, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 2.77% (0.5818 => 0.5979, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1923, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: 2.65% (0.7061 => 0.7248, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.7710 => 0.7912, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 2.59% (0.5748 => 0.5897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.30% (1.1061 => 1.1315, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (3.8646 => 3.9510, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.14% (1.9270 => 1.9683, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.2842 => 13.5653, std. dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8698 => 0.8871, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.94% (1.3819 => 1.4087, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6692 => 3.7127, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0119, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.05% (16.2614 => 16.4326, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 25.98% (1.8175 => 2.2897, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: 9.26% (1.2998 => 1.4202, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7072, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5156, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9771, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.75% (7.9275 => 8.1458, std. dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7134, std. dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (0.5184 => 0.5305, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1886, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.39% (22.5627 => 20.8950, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.35% (0.6576 => 0.6356, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: -2.98% (0.3623 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.84% (0.3663 => 0.3559, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -2.67% (0.3789 => 0.3688, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.97% (0.9108 => 0.8929, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5990, std. dev.: 0.0133) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1123, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9588, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9218, std. dev.: 0.0392) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6969, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4905, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2312, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.19% (0.9692 => 0.9577, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 09:38:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 11:38:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619163844.E918D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1260?compare_to=1257&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1260, Order: 158719, Start Time: 2012-06-19 15:39:57, End Time: 2012-06-19 16:40:12 To: 1257, Order: 158716, Start Time: 2012-06-19 14:12:40, End Time: 2012-06-19 15:13:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (2 on baseline) Performance Improvements: 2 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.93% (10.3478 => 10.5475, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (10.3348 => 10.4444, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -11.45% (21.4131 => 18.9612, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.27% (2.0921 => 2.0655, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.74% (10.3673 => 10.5475, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.46% (26.0924 => 26.7330, std. dev.: 0.0351) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.01% (0.8651 => 0.7266, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -14.50% (22.1758 => 18.9612, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.51% (5.2763 => 4.7743, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.92% (2.9384 => 2.6763, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (1.1194 => 1.0365, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4628, std. dev.: 0.0238) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.53% (5.3855 => 5.1413, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.26% (6.6874 => 6.4028, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.35% (2.2022 => 2.1284, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.98% (5.3526 => 5.1929, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.36% (0.4879 => 0.4764, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.74% (1.7609 => 1.7302, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.71% (7.0540 => 6.9334, std. dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (7.9617 => 7.8649, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 10:51:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 12:51:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619175137.A23F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1261?compare_to=1259&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1261, Order: 158722, Start Time: 2012-06-19 16:56:22, End Time: 2012-06-19 17:53:04 To: 1259, Order: 158719, Start Time: 2012-06-19 15:32:52, End Time: 2012-06-19 16:29:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (751 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.11% (1.4202 => 1.4044, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.20% (2.0176 => 2.2840, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.07% (0.2781 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2966 => 0.3112, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.89% (0.2782 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.87% (0.2690 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.82% (0.2655 => 0.2783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.67% (1.9828 => 2.0753, std. dev.: 0.0094) MultiSource/Applications/hbd/hbd: 4.58% (1.3693 => 1.4320, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3489 => 0.3639, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3485 => 0.3630, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2292 => 1.2797, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.6959 => 0.7211, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.55% (0.4390 => 0.4546, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1023, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.32% (0.9199 => 0.9504, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 3.05% (16.6129 => 17.1203, std. dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.7038 => 0.7249, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.5818 => 0.5982, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2401, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.72% (0.7710 => 0.7920, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1876, std. dev.: 0.0232) SingleSource/UnitTests/ObjC++/property-reference: 2.65% (0.7061 => 0.7248, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.54% (0.5748 => 0.5894, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9516, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5755, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.11% (1.9270 => 1.9676, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4063, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.73% (1.3813 => 1.4052, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7090, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0099, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.86% (0.1824 => 0.3536, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2759, std. dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7145, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0380) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1389, std. dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: 2.59% (4.5928 => 4.7119, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9569, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2449, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8838, std. dev.: 0.0263) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.6576 => 0.6345, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -2.92% (0.3601 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.69% (0.3789 => 0.3687, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3050, std. dev.: 0.0107) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5890, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.20% (9.3358 => 9.1303, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9259, std. dev.: 0.0594) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6986, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8588, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2415, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 11:05:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 13:05:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619180541.BD6122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1262?compare_to=1260&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1262, Order: 158722, Start Time: 2012-06-19 17:06:54, End Time: 2012-06-19 18:07:08 To: 1260, Order: 158719, Start Time: 2012-06-19 15:39:57, End Time: 2012-06-19 16:40:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.73% (3.7643 => 3.8296, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (10.3673 => 10.5464, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.66% (26.0924 => 26.7874, std. dev.: 0.0099) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7781 => 3.8296, std. dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.95% (0.8651 => 0.7271, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -14.51% (22.1758 => 18.9588, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.57% (5.2763 => 4.7711, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.96% (2.9384 => 2.6751, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (1.1194 => 1.0377, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4827, std. dev.: 0.0175) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.56% (5.3855 => 5.1400, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.33% (6.6874 => 6.3980, std. dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.34% (2.2022 => 2.1286, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.99% (5.3526 => 5.1925, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.52% (0.4879 => 0.4756, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.82% (1.7609 => 1.7288, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.69% (7.0540 => 6.9345, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (7.9617 => 7.8617, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 12:05:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 14:05:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619190517.870182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1263?compare_to=1258&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1263, Order: 158722, Start Time: 2012-06-19 16:51:25, End Time: 2012-06-19 19:06:44 To: 1258, Order: 158716, Start Time: 2012-06-19 14:09:21, End Time: 2012-06-19 16:24:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (887 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0673 => 2.1132, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.22% (23.5202 => 24.0424, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 1.90% (0.9909 => 1.0097, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.6435 => 0.6547, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.63% (0.9697 => 0.9855, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.2122 => 0.2266, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.16% (2.4764 => 2.4228, std. dev.: 0.0127) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 12:16:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 14:16:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619191612.CCCD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1264?compare_to=1261&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1264, Order: 158728, Start Time: 2012-06-19 18:20:54, End Time: 2012-06-19 19:17:39 To: 1261, Order: 158722, Start Time: 2012-06-19 16:56:22, End Time: 2012-06-19 17:53:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (749 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (2.0176 => 2.2843, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.22% (0.4328 => 0.4597, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2781 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.87% (0.2607 => 0.2734, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.75% (0.2760 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.59% (0.2765 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.58% (1.9828 => 2.0736, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.46% (1.3693 => 1.4304, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3293 => 0.3421, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4390 => 0.4552, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (3.9660 => 4.1013, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.23% (0.7038 => 0.7265, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.3245 => 1.3652, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1176, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 2.87% (0.5818 => 0.5985, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2032, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 2.77% (2.1791 => 2.2394, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7061 => 0.7249, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 2.56% (0.5748 => 0.5895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2480, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9545, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.4563 => 1.4896, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.18% (1.9270 => 1.9690, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.16% (1.1061 => 1.1300, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.2842 => 13.5695, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.79% (1.3819 => 1.4067, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.3813 => 1.4042, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0226, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4352, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1905, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9996 => 1.0795, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7283, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5187, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.80% (7.9275 => 8.1498, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7134, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5184 => 0.5297, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2449, std. dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 1.13% (3.7731 => 3.8158, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.41% (22.5627 => 20.8916, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.47% (0.6576 => 0.6348, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.8818 => 0.8538, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3650 => 0.3541, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.81% (0.3663 => 0.3560, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3056, std. dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0136) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5999, std. dev.: 0.0123) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1052, std. dev.: 0.0141) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4867 => 0.4760, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9201, std. dev.: 0.0275) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6969, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2577, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4878, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2384, std. dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 12:32:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 14:32:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619193252.6F9362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1265?compare_to=1262&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1265, Order: 158729, Start Time: 2012-06-19 18:33:56, End Time: 2012-06-19 19:34:18 To: 1262, Order: 158722, Start Time: 2012-06-19 17:06:54, End Time: 2012-06-19 18:07:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (1 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (10.5464 => 10.3561, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.40% (26.0924 => 26.7175, std. dev.: 0.0460) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.04% (0.8651 => 0.7263, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -14.52% (22.1758 => 18.9566, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.40% (5.2763 => 4.7805, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.82% (2.9384 => 2.6793, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.10% (1.1194 => 1.0399, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.09% (54.1659 => 51.4088, std. dev.: 0.1205) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.55% (5.3855 => 5.1404, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.17% (6.6874 => 6.4083, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.17% (2.2022 => 2.1323, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.89% (5.3526 => 5.1981, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.25% (0.4879 => 0.4769, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.60% (7.0540 => 6.9410, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.40% (1.7609 => 1.7362, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (7.9617 => 7.8770, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 13:39:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 15:39:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619203938.741B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1266?compare_to=1264&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1266, Order: 158734, Start Time: 2012-06-19 19:44:20, End Time: 2012-06-19 20:41:05 To: 1264, Order: 158728, Start Time: 2012-06-19 18:20:54, End Time: 2012-06-19 19:17:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (754 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.36% (2.0176 => 2.2872, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4328 => 0.4594, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.29% (0.4062 => 0.4277, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.05% (0.3107 => 0.3264, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.99% (1.9828 => 2.0817, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 4.70% (1.3693 => 1.4337, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.31% (1.2292 => 1.2822, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9199 => 0.9536, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.61% (3.9660 => 4.1092, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 3.29% (16.6129 => 17.1597, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.3245 => 1.3664, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.12% (1.0594 => 1.0925, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 3.07% (0.7038 => 0.7254, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.7710 => 0.7943, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2278, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2399, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 2.72% (0.5818 => 0.5976, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 2.52% (0.7061 => 0.7239, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9608, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.4563 => 1.4914, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 2.30% (0.5748 => 0.5880, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5577 => 0.5705, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 2.23% (1.9270 => 1.9699, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5726, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.11% (1.3819 => 1.4111, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.3813 => 1.4081, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.45% (0.7506 => 0.7615, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0434, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (3.6692 => 3.7124, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 26.85% (1.8175 => 2.3055, std. dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9996 => 1.0793, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7224, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8317, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5193, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5858, std. dev.: 0.0383) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1463, std. dev.: 0.0167) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7143, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9285, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -2.76% (0.3623 => 0.3523, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0113) MultiSource/Applications/minisat/minisat: -2.29% (9.3358 => 9.1219, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9605, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7017, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9768, std. dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 14:00:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 16:00:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619210007.3BDE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1267?compare_to=1265&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1267, Order: 158735, Start Time: 2012-06-19 20:01:07, End Time: 2012-06-19 21:01:34 To: 1265, Order: 158729, Start Time: 2012-06-19 18:33:56, End Time: 2012-06-19 19:34:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (3 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 870 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 14.42% (18.9566 => 21.6895, std. dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (10.3561 => 10.6421, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.14% (10.4589 => 10.5783, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.65% (10.3673 => 10.6421, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (10.4361 => 10.5783, std. dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7454, std. dev.: 0.0268) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.95% (0.8651 => 0.7271, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.48% (5.2763 => 4.7762, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (2.9384 => 2.6924, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.11% (1.1194 => 1.0398, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4172, std. dev.: 0.0406) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.39% (6.6874 => 6.3938, std. dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.25% (5.3855 => 5.1564, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.23% (2.2022 => 2.1311, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.09% (5.3526 => 5.1874, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.38% (0.4879 => 0.4763, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -2.19% (22.1758 => 21.6895, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.57% (1.7609 => 1.7333, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.46% (7.0540 => 6.9511, std. dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (7.9617 => 7.8758, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 14:47:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 16:47:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120619214715.3E7A92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1268?compare_to=1263&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1268, Order: 158734, Start Time: 2012-06-19 19:33:16, End Time: 2012-06-19 21:48:41 To: 1263, Order: 158722, Start Time: 2012-06-19 16:51:25, End Time: 2012-06-19 19:06:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 2 (0 on baseline) Unchanged Tests: 892 (889 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -2.04% (0.7246 => 0.7098, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: -1.05% (0.9855 => 0.9752, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 2.14% (23.5202 => 24.0238, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (2.0673 => 2.1091, std. dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 2.02% (0.9909 => 1.0109, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.65% (0.6435 => 0.6541, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0016) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 15:02:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 17:02:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619220258.620242A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1269?compare_to=1266&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1269, Order: 158735, Start Time: 2012-06-19 21:07:42, End Time: 2012-06-19 22:04:24 To: 1266, Order: 158734, Start Time: 2012-06-19 19:44:20, End Time: 2012-06-19 20:41:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.71% (2.3055 => 2.2661, std. dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (2.0176 => 2.2869, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4328 => 0.4594, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0800, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.72% (1.3693 => 1.4339, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2292 => 1.2819, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3293 => 0.3422, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4390 => 0.4551, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1101, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.12% (1.0594 => 1.0925, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.3245 => 1.3657, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 3.10% (0.7038 => 0.7256, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 3.08% (16.6129 => 17.1253, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2287, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.91% (0.7710 => 0.7934, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.5818 => 0.5981, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2398, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.59% (0.7061 => 0.7244, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (3.8646 => 3.9597, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.1364 => 1.1636, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.35% (0.5748 => 0.5883, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9713, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.8698 => 0.8895, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5738, std. dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (1.3813 => 1.4082, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.52% (0.7506 => 0.7620, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0324, std. dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7121, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1448, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.24% (0.9996 => 1.0820, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7170, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5150, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7170, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1409, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.28% (1.2308 => 1.2465, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.00% (0.4657 => 0.3772, std. dev.: 0.0277) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9522, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.18% (0.6576 => 0.6367, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0222) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.19% (9.3358 => 9.1314, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9332, std. dev.: 0.0415) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2584, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2375, std. dev.: 0.0217) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8454, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 15:27:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 17:27:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619222715.17EE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1270?compare_to=1267&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1270, Order: 158738, Start Time: 2012-06-19 21:28:14, End Time: 2012-06-19 22:28:39 To: 1267, Order: 158735, Start Time: 2012-06-19 20:01:07, End Time: 2012-06-19 21:01:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (3 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.38% (7.9507 => 8.0605, std. dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (10.3673 => 10.6351, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (10.4361 => 10.5729, std. dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7613, std. dev.: 0.0314) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.99% (0.8651 => 0.7268, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.60% (5.2763 => 4.7699, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.55% (2.9384 => 2.6873, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.22% (1.1194 => 1.0386, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4426, std. dev.: 0.0459) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.38% (6.6874 => 6.3943, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.33% (5.3855 => 5.1521, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.23% (2.2022 => 2.1310, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.17% (5.3526 => 5.1827, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.48% (0.4879 => 0.4758, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -2.25% (22.1758 => 21.6773, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.65% (1.7609 => 1.7319, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.62% (7.0540 => 6.9395, std. dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (7.9617 => 7.8749, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 16:26:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 18:26:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120619232636.F06722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1271?compare_to=1269&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1271, Order: 158749, Start Time: 2012-06-19 22:31:12, End Time: 2012-06-19 23:28:03 To: 1269, Order: 158735, Start Time: 2012-06-19 21:07:42, End Time: 2012-06-19 22:04:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2908, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.22% (0.4328 => 0.4597, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.57% (0.2781 => 0.2936, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (1.9828 => 2.0838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.3489 => 0.3653, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 4.62% (1.2292 => 1.2860, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3580 => 0.3745, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.2988 => 0.3124, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 4.55% (1.3693 => 1.4316, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.08% (0.6959 => 0.7243, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.97% (0.2596 => 0.2699, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.96% (0.4390 => 0.4564, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.95% (3.9660 => 4.1227, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.5265 => 0.5465, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.7710 => 0.8002, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.55% (16.6129 => 17.2021, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.42% (1.3245 => 1.3698, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7038 => 0.7271, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 3.30% (0.5818 => 0.6010, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.09% (0.7061 => 0.7279, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2325, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.91% (2.1791 => 2.2425, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 2.89% (0.5748 => 0.5914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9736, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.62% (1.1061 => 1.1351, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (13.2842 => 13.6324, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.44% (1.9270 => 1.9741, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.4563 => 1.4911, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.8698 => 0.8901, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (1.3819 => 1.4099, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.97% (1.3813 => 1.4085, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.57% (0.7506 => 0.7624, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.48% (3.6692 => 3.7234, std. dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0676, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (7.2180 => 7.2991, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6488, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2237, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1881, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 6.78% (1.2998 => 1.3879, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7274, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5841, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7170, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1395, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.79% (10.7476 => 10.9396, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9555, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.50% (0.4657 => 0.3842, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9233, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.88% (0.9108 => 0.8937, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5814, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.64% (20.3410 => 19.8038, std. dev.: 0.0786) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.29% (9.3358 => 9.1220, std. dev.: 0.0134) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9593, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7008, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5146, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2535, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2321, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 16:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 18:54:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120619235428.81CA62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1272?compare_to=1270&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1272, Order: 158750, Start Time: 2012-06-19 22:55:30, End Time: 2012-06-19 23:55:54 To: 1270, Order: 158738, Start Time: 2012-06-19 21:28:14, End Time: 2012-06-19 22:28:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 1 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.11% (10.6351 => 10.1984, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.30% (10.4361 => 10.5713, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7647, std. dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.00% (0.8651 => 0.7267, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.52% (5.2763 => 4.7742, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.43% (2.9384 => 2.6906, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.21% (1.1194 => 1.0387, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4528, std. dev.: 0.0486) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.73% (6.6874 => 6.3710, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.45% (5.3855 => 5.1460, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.22% (5.3526 => 5.1802, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.10% (2.2022 => 2.1339, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -2.37% (22.1758 => 21.6500, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.32% (0.4879 => 0.4766, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.64% (7.0540 => 6.9383, std. dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -1.63% (10.3673 => 10.1984, std. dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.45% (7.9617 => 7.8462, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.29% (1.7609 => 1.7381, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 17:29:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 19:29:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620002940.38E852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1273?compare_to=1268&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1273, Order: 158745, Start Time: 2012-06-19 22:15:22, End Time: 2012-06-20 00:31:06 To: 1268, Order: 158734, Start Time: 2012-06-19 19:33:16, End Time: 2012-06-19 21:48:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (3 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 891 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 2.12% (0.5790 => 0.5913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.07% (0.5845 => 0.5966, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (2.0371 => 2.0723, std. dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 2.59% (23.5202 => 24.1298, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (2.0673 => 2.1155, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.99% (0.9909 => 1.0106, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.97% (2.4764 => 2.4277, std. dev.: 0.0019) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 17:49:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 19:49:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620004959.58BDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1274?compare_to=1271&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1274, Order: 158759, Start Time: 2012-06-19 23:54:43, End Time: 2012-06-20 00:51:26 To: 1271, Order: 158749, Start Time: 2012-06-19 22:31:12, End Time: 2012-06-19 23:28:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (101 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (755 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.50% (25.8078 => 26.1943, std. dev.: 0.0502) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.3879 => 1.4070, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.00% (10.9396 => 10.8298, std. dev.: 0.0206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2846, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.60% (0.2607 => 0.2727, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.57% (0.3022 => 0.3160, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2726 => 0.2850, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2690 => 0.2811, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2760 => 0.2883, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.45% (0.2765 => 0.2888, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.34% (0.2696 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.33% (1.9828 => 2.0687, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.23% (1.3693 => 1.4272, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.99% (0.3580 => 0.3723, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.97% (0.2596 => 0.2699, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.86% (1.2292 => 1.2767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3192 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5265 => 0.5457, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (3.9660 => 4.1105, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.59% (0.3534 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (0.9199 => 0.9527, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (0.3756 => 0.3887, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.36% (0.7710 => 0.7969, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.35% (16.6129 => 17.1696, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.35% (0.4390 => 0.4537, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.31% (0.3293 => 0.3402, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3676, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.01% (0.7038 => 0.7250, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.91% (2.1791 => 2.2426, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2214, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.70% (0.5818 => 0.5975, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (3.8646 => 3.9642, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.54% (1.1061 => 1.1342, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.51% (0.7061 => 0.7238, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9739, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 2.37% (0.5748 => 0.5884, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5954, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.8698 => 0.8890, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0660, std. dev.: 0.0154) MultiSource/Applications/spiff/spiff: 1.41% (0.7506 => 0.7612, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4004, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7136, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.25% (1.2998 => 1.4070, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7241, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.91% (11.2619 => 11.5893, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1479, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7165, std. dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.63% (0.4657 => 0.3743, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9884, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5914, std. dev.: 0.0144) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1132, std. dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8930, std. dev.: 0.0414) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0220) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 18:21:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 20:21:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620012148.A1DE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1275?compare_to=1272&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1275, Order: 158764, Start Time: 2012-06-20 00:22:44, End Time: 2012-06-20 01:23:16 To: 1272, Order: 158750, Start Time: 2012-06-19 22:55:30, End Time: 2012-06-19 23:55:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.25% (10.4361 => 10.5661, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7804, std. dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.32% (0.8651 => 0.7326, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.43% (5.2763 => 4.7790, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.31% (2.9384 => 2.6942, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.25% (1.1194 => 1.0382, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3056, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.76% (6.6874 => 6.3694, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.01% (5.3855 => 5.1695, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.91% (5.3526 => 5.1970, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.87% (2.2022 => 2.1390, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -2.35% (22.1758 => 21.6543, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.19% (0.4879 => 0.4772, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.49% (7.0540 => 6.9486, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.06% (1.7609 => 1.7423, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (7.9617 => 7.8791, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 19:42:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 21:42:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620024213.AD59B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1276?compare_to=1274&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1276, Order: 158781, Start Time: 2012-06-20 01:46:45, End Time: 2012-06-20 02:43:40 To: 1274, Order: 158759, Start Time: 2012-06-19 23:54:43, End Time: 2012-06-20 00:51:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 23 (124 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 870 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 6.41% (0.3524 => 0.3750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3507 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.36% (0.3554 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.33% (0.3492 => 0.3713, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.27% (0.3571 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.11% (0.3701 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.91% (0.3555 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.87% (0.3832 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.84% (0.3850 => 0.4075, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.60% (0.3927 => 0.4147, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.06% (0.5884 => 0.6123, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 4.05% (0.7238 => 0.7531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.98% (0.5975 => 0.6213, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7969 => 0.8120, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (2.0687 => 2.0990, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.43% (0.7612 => 0.7721, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.4055 => 4.4609, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (4.4623 => 4.5179, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2767 => 1.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (7.2683 => 7.3509, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.4850 => 1.5017, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.05% (1.4004 => 1.4151, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.01% (4.1105 => 4.1520, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.50% (26.1943 => 25.8004, std. dev.: 0.0222) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.84% (2.0176 => 2.2968, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5818 => 0.6213, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4328 => 0.4621, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.66% (0.7061 => 0.7531, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2761 => 0.2932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.3022 => 0.3208, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.93% (0.2765 => 0.2929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.86% (1.9828 => 2.0990, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.7710 => 0.8120, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2292 => 1.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.75% (1.3693 => 1.4343, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1520, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.6959 => 0.7282, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.5265 => 0.5503, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.3245 => 1.3795, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.9199 => 0.9569, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.91% (16.6129 => 17.2622, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3755 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.77% (0.3578 => 0.3713, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.0594 => 1.0990, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: 3.68% (0.3646 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.65% (0.3914 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.64% (0.3789 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.61% (0.3601 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.60% (0.3663 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.60% (0.4003 => 0.4147, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.51% (0.3623 => 0.3750, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.45% (0.7038 => 0.7281, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.44% (13.8202 => 14.2959, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 3.43% (0.3940 => 0.4075, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.41% (2.1791 => 2.2535, std. dev.: 0.0197) MultiSource/Applications/treecc/treecc: 3.29% (1.9270 => 1.9904, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (3.8646 => 3.9915, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.15% (0.3650 => 0.3765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2574, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.4563 => 1.5017, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1709, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.97% (1.1061 => 1.1389, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.86% (0.7506 => 0.7721, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8698 => 0.8946, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (13.2842 => 13.6572, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.53% (1.3819 => 1.4169, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4151, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (3.6692 => 3.7441, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.99% (14.8535 => 15.1491, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.6135 => 0.6257, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.1333 => 1.1544, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.3801 => 4.4609, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.84% (7.2180 => 7.3509, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6283 => 0.6394, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5179, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6826, std. dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2282, std. dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4562, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7031, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (3.2742 => 3.3098, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (2.1007 => 2.1227, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2608, std. dev.: 0.0442) SingleSource/Benchmarks/Misc/mandel-2: 8.41% (1.2998 => 1.4091, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7115, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9181, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5175, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.77% (7.9275 => 8.1469, std. dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 2.59% (4.5928 => 4.7119, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9880, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1041, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.45% (8.8259 => 8.6099, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9560, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9281, std. dev.: 0.0656) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2366, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.21% (3.8887 => 3.8415, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 19:52:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 21:52:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620025243.7F1982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1277?compare_to=1275&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1277, Order: 158782, Start Time: 2012-06-20 01:53:36, End Time: 2012-06-20 02:54:10 To: 1275, Order: 158764, Start Time: 2012-06-20 00:22:44, End Time: 2012-06-20 01:23:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 25 (18 on baseline) Performance Improvements: 2 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 846 (843 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3475 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.87% (0.3494 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.80% (0.3514 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.58% (0.3548 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.33% (0.3697 => 0.3968, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 7.30% (0.3823 => 0.4102, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3932 => 0.4200, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.76% (0.3890 => 0.4153, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.17% (0.5953 => 0.6261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.16% (0.5855 => 0.6157, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.66% (0.7227 => 0.7564, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.8207 => 0.8354, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.63% (2.0785 => 2.1123, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (10.2892 => 10.4548, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 1.56% (0.7802 => 0.7924, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (5.1695 => 5.2497, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (4.9721 => 5.0417, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2885 => 1.3045, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.9232 => 4.9807, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (8.0730 => 8.1670, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 1.14% (21.6543 => 21.9004, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.5310 => 1.5482, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (6.9486 => 7.0215, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.10% (5.1970 => 5.1398, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1276 => 1.1027, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.95% (0.3473 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.74% (0.3516 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3543 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3694 => 0.3968, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3828 => 0.4102, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 6.95% (0.3927 => 0.4200, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.87% (0.3886 => 0.4153, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.92% (0.5925 => 0.6157, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.83% (0.6030 => 0.6261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.25% (0.7326 => 0.7564, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.8172 => 0.8354, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1123, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2842 => 1.3045, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7725, std. dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.21% (0.8651 => 0.7335, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.92% (5.2763 => 4.8058, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.60% (2.9384 => 2.6856, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (1.1194 => 1.0427, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4780, std. dev.: 0.0245) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.02% (6.6874 => 6.4189, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.98% (5.3526 => 5.1398, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.52% (5.3855 => 5.2497, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.28% (2.2022 => 2.1520, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -1.24% (22.1758 => 21.9004, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.11% (1.7609 => 1.7413, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 20:11:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 22:11:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620031135.505822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1278?compare_to=1273&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1278, Order: 158769, Start Time: 2012-06-20 00:57:42, End Time: 2012-06-20 03:13:02 To: 1273, Order: 158745, Start Time: 2012-06-19 22:15:22, End Time: 2012-06-20 00:31:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (1 on baseline) Performance Improvements: 6 (3 on baseline) Unchanged Tests: 887 (890 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.2269 => 0.2409, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -2.92% (0.5966 => 0.5792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.89% (0.5913 => 0.5742, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.64% (0.7224 => 0.7033, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.47% (2.1155 => 2.0844, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -1.37% (1.0106 => 0.9968, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.23% (24.1298 => 23.8330, std. dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.33% (23.5202 => 23.8330, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.4253 => 0.4131, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -1.92% (0.7171 => 0.7033, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.06% (1.9966 => 1.9755, std. dev.: 0.0007) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 21:05:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 23:05:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620040551.AC7952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1279?compare_to=1276&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1279, Order: 158785, Start Time: 2012-06-20 03:10:29, End Time: 2012-06-20 04:07:18 To: 1276, Order: 158781, Start Time: 2012-06-20 01:46:45, End Time: 2012-06-20 02:43:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.72% (0.4319 => 0.4072, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2928, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.53% (0.5818 => 0.6198, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4062 => 0.4318, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5748 => 0.6099, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7061 => 0.7480, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.7710 => 0.8086, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2292 => 1.2880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.52% (1.3693 => 1.4312, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.42% (3.9660 => 4.1411, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.30% (0.6959 => 0.7258, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4390 => 0.4571, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9199 => 0.9553, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.3245 => 1.3725, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.52% (16.6129 => 17.1981, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.30% (13.8202 => 14.2765, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 3.19% (0.3914 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.16% (0.3578 => 0.3691, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.05% (0.4003 => 0.4125, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (3.8646 => 3.9811, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 2.98% (0.3623 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.98% (0.3663 => 0.3772, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.92% (1.9270 => 1.9833, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.91% (0.7038 => 0.7243, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2422, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.2193 => 1.2540, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.4563 => 1.4969, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.59% (0.8698 => 0.8923, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.7460 => 0.7651, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (13.2842 => 13.6145, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.3819 => 1.4115, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4101, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7364, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (7.2180 => 7.3379, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (4.3801 => 4.4490, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.53% (14.8535 => 15.0813, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (4.4433 => 4.5079, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (6.5754 => 6.6642, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.55% (1.8175 => 2.3001, std. dev.: 0.0312) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3910, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7202, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.78% (12.4560 => 12.9271, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1466, std. dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7149, std. dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.31% (1.2308 => 1.2469, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.56% (0.4657 => 0.4072, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.19% (22.5627 => 20.9407, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.93% (0.9108 => 0.8932, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6005, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.33% (9.3358 => 9.1184, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9280, std. dev.: 0.0672) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6973, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.52% (0.9692 => 0.9545, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2364, std. dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 21:20:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 19 Jun 2012 23:20:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620042011.D3A232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1280?compare_to=1277&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1280, Order: 158785, Start Time: 2012-06-20 03:21:06, End Time: 2012-06-20 04:21:38 To: 1277, Order: 158782, Start Time: 2012-06-20 01:53:36, End Time: 2012-06-20 02:54:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (18 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (842 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.7373 => 3.6990, std. dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.26% (0.3473 => 0.3725, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.03% (0.3543 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3561 => 0.3811, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.72% (0.3543 => 0.3781, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 6.66% (0.3694 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3828 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.3927 => 0.4181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.33% (0.3886 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5925 => 0.6128, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6030 => 0.6225, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7326 => 0.7521, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.8172 => 0.8355, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.60% (2.0665 => 2.0995, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3006, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3147, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7414, std. dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.92% (0.8651 => 0.7274, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.08% (5.2763 => 4.7974, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (2.9384 => 2.6900, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.79% (1.1194 => 1.0434, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4509, std. dev.: 0.0814) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.28% (5.3526 => 5.1233, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.96% (6.6874 => 6.4228, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.13% (5.3855 => 5.2172, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.53% (2.2022 => 2.1465, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.13% (0.4879 => 0.4775, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.52% (1.7609 => 1.7342, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -1.20% (22.1758 => 21.9089, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 22:29:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 00:29:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620052925.931252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1281?compare_to=1279&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1281, Order: 158787, Start Time: 2012-06-20 04:34:05, End Time: 2012-06-20 05:30:52 To: 1279, Order: 158785, Start Time: 2012-06-20 03:10:29, End Time: 2012-06-20 04:07:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.22% (2.2928 => 2.2649, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2649, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.63% (0.5818 => 0.6204, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5748 => 0.6113, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 6.09% (0.7061 => 0.7491, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.61% (1.9828 => 2.0940, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.7710 => 0.8103, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3580 => 0.3757, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.88% (1.2292 => 1.2892, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.62% (1.3693 => 1.4326, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4390 => 0.4586, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.34% (3.9660 => 4.1380, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.08% (0.6959 => 0.7243, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9199 => 0.9547, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3721, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.42% (16.6129 => 17.1815, std. dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: 3.41% (0.3578 => 0.3700, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 3.35% (0.3914 => 0.4045, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.30% (0.3789 => 0.3914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.24% (13.8202 => 14.2683, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 3.24% (0.3646 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.22% (0.3601 => 0.3717, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.15% (0.3623 => 0.3737, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.7038 => 0.7255, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9831, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.95% (1.9270 => 1.9839, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (13.2842 => 13.6599, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.79% (0.3650 => 0.3752, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.4563 => 1.4965, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.72% (0.7460 => 0.7663, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.1364 => 1.1671, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2375, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.63% (1.1061 => 1.1352, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.11% (1.3819 => 1.4111, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.88% (7.2180 => 7.3540, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7303, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.3801 => 4.4518, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.4433 => 4.5126, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.1333 => 1.1506, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0684, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.40% (6.5754 => 6.6674, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 1.21% (14.5298 => 14.7060, std. dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2235, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.17% (1.8175 => 2.2749, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.25% (2.0200 => 2.1867, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.75% (1.2998 => 1.3876, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7333, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5169, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1421, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7131, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.45% (0.5184 => 0.5311, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 1.37% (10.7476 => 10.8944, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.55% (0.4657 => 0.3933, std. dev.: 0.0226) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9366, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.81% (0.3511 => 0.3272, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6028, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9581, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -2.18% (9.3358 => 9.1326, std. dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9542, std. dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7000, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.52% (0.9692 => 0.9545, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2460, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 22:47:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 00:47:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620054744.B146A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1282?compare_to=1280&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1282, Order: 158788, Start Time: 2012-06-20 04:48:27, End Time: 2012-06-20 05:49:11 To: 1280, Order: 158785, Start Time: 2012-06-20 03:21:06, End Time: 2012-06-20 04:21:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (20 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (841 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.03% (0.3473 => 0.3717, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.92% (0.3497 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.88% (0.3516 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3561 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.30% (0.3828 => 0.4069, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.16% (0.3927 => 0.4169, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.10% (0.3886 => 0.4123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.6030 => 0.6236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.32% (0.5925 => 0.6122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.8172 => 0.8339, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (2.0665 => 2.1041, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.45% (1.2842 => 1.3028, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 1.31% (10.3673 => 10.5034, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 1.08% (2.0273 => 2.0492, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.60% (26.0924 => 26.7707, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3045 => 1.3186, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.36% (0.8651 => 0.7236, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.11% (5.2763 => 4.7957, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (2.9384 => 2.6900, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (1.1194 => 1.0435, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4510, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.49% (5.3526 => 5.1121, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.23% (6.6874 => 6.4048, std. dev.: 0.0356) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.21% (5.3855 => 5.2128, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.03% (2.2022 => 2.1576, std. dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: -1.24% (22.1758 => 21.8998, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (1.7609 => 1.7396, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 22:53:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 00:53:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620055347.CE2D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1283?compare_to=1278&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1283, Order: 158786, Start Time: 2012-06-20 03:39:48, End Time: 2012-06-20 05:55:15 To: 1278, Order: 158769, Start Time: 2012-06-20 00:57:42, End Time: 2012-06-20 03:13:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 45 (46 on baseline) Unchanged Tests: 849 (848 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.94% (0.3463 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3437 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.87% (0.3444 => 0.3715, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/synchronized: 7.79% (0.3464 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3458 => 0.3727, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3493 => 0.3764, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.3715 => 0.3997, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.52% (0.3486 => 0.3748, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 7.49% (0.3646 => 0.3919, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.47% (0.3641 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.96% (0.5792 => 0.6137, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.89% (0.5742 => 0.6080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.18% (0.7033 => 0.7397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (1.9509 => 2.0230, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9755 => 2.0456, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.49% (0.5011 => 0.5186, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.43% (0.3989 => 0.4126, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (1.6150 => 1.6645, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (3.5468 => 3.6550, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 2.95% (4.1812 => 4.3044, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (0.3907 => 0.4021, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (1.3096 => 1.3465, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (0.4972 => 0.5109, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (0.4965 => 0.5101, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.5888 => 0.6044, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.65% (0.4612 => 0.4734, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.58% (0.7785 => 0.7986, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.44% (5.5191 => 5.6538, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 2.43% (4.5916 => 4.7032, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (2.0844 => 2.1339, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (0.4337 => 0.4439, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.32% (2.7068 => 2.7695, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 2.28% (0.9968 => 1.0195, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (4.3907 => 4.4882, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.18% (1.4158 => 1.4467, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (2.1580 => 2.2040, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.12% (1.0745 => 1.0973, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (1.8680 => 1.9058, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (2.0841 => 2.1239, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.89% (0.9641 => 0.9823, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.30% (23.8330 => 24.1424, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 1.24% (11.9645 => 12.1130, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 1.22% (1.5963 => 1.6158, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.13% (2.0217 => 2.0446, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: 1.03% (12.2303 => 12.3566, std. dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.88% (0.3465 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.81% (0.3446 => 0.3715, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 7.73% (0.3442 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.72% (0.3460 => 0.3727, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.67% (0.3496 => 0.3764, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3469 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3488 => 0.3748, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3643 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.37% (0.3650 => 0.3919, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.33% (0.3724 => 0.3997, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 4.36% (0.5826 => 0.6080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.21% (0.5889 => 0.6137, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (2.0673 => 2.1339, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (0.5026 => 0.5186, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 3.15% (0.7171 => 0.7397, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (0.3625 => 0.3732, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3678 => 0.3785, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4146 => 0.4266, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.89% (0.9909 => 1.0195, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.82% (0.3726 => 0.3831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.72% (1.9694 => 2.0230, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (1.6211 => 1.6645, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.65% (23.5202 => 24.1424, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.59% (3.5627 => 3.6550, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (1.9966 => 2.0456, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.5900 => 0.6044, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (1.3152 => 1.3465, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (0.4994 => 0.5109, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.22% (4.2109 => 4.3044, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.5012 => 0.5114, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.02% (5.5417 => 5.6538, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (0.5000 => 0.5101, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.85% (4.6177 => 4.7032, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 1.79% (2.1653 => 2.2040, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.78% (1.0781 => 1.0973, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (4.4195 => 4.4882, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (2.7292 => 2.7695, std. dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 1.42% (1.5932 => 1.6158, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.41% (0.7875 => 0.7986, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.40% (1.8794 => 1.9058, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.39% (1.4269 => 1.4467, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.32% (11.9555 => 12.1130, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 1.30% (0.9697 => 0.9823, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (2.1013 => 2.1239, std. dev.: 0.0018) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 19 23:52:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 01:52:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620065259.7CA892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1284?compare_to=1281&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1284, Order: 158789, Start Time: 2012-06-20 05:57:41, End Time: 2012-06-20 06:54:26 To: 1281, Order: 158787, Start Time: 2012-06-20 04:34:05, End Time: 2012-06-20 05:30:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (122 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.85% (1.3876 => 1.4133, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/lowercase: 1.04% (7.9627 => 8.0458, std. dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.30% (2.0176 => 2.2657, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.5818 => 0.6201, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.25% (0.5748 => 0.6107, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.21% (0.2945 => 0.3128, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.15% (0.7061 => 0.7495, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (1.9828 => 2.0938, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.7710 => 0.8115, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2292 => 1.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.66% (1.3693 => 1.4331, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4390 => 0.4586, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.36% (3.9660 => 4.1388, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.6959 => 0.7253, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.75% (0.9199 => 0.9544, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3720, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5637 => 0.5834, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.38% (16.6129 => 17.1742, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 3.33% (0.3578 => 0.3697, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.33% (0.3789 => 0.3915, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2793, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions: 3.30% (0.3914 => 0.4043, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.22% (0.4003 => 0.4132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3601 => 0.3715, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 3.06% (0.3623 => 0.3734, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2562, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.7038 => 0.7249, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.99% (0.3940 => 0.4058, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.96% (1.9270 => 1.9841, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (3.8646 => 3.9782, std. dev.: 0.0067) MultiSource/Applications/siod/siod: 2.84% (2.1791 => 2.2410, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.4563 => 1.4971, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.74% (0.3650 => 0.3750, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5577 => 0.5728, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.8698 => 0.8925, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.60% (0.7460 => 0.7654, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.60% (0.7506 => 0.7701, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (13.2842 => 13.6276, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.11% (1.3819 => 1.4110, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4101, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6135 => 0.6251, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (7.2180 => 7.3492, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4560, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7309, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.4433 => 4.5121, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0686, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1491, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6615, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.08% (3.1889 => 3.2232, std. dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.5298 => 14.6780, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.17% (1.8175 => 2.2750, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/mandel-2: 8.73% (1.2998 => 1.4133, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.34% (0.9996 => 1.0830, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7313, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5185, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.90% (7.9275 => 8.1571, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7149, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1881, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5114, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.34% (1.4298 => 1.4490, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.02% (0.4657 => 0.4004, std. dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9512, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3511 => 0.3270, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.30% (0.8818 => 0.8527, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5877, std. dev.: 0.0144) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1102, std. dev.: 0.0153) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9592, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6972, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9630, std. dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2615, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2364, std. dev.: 0.0244) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 00:17:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 02:17:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620071757.CE55B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1285?compare_to=1282&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1285, Order: 158792, Start Time: 2012-06-20 06:16:39, End Time: 2012-06-20 07:19:24 To: 1282, Order: 158788, Start Time: 2012-06-20 04:48:27, End Time: 2012-06-20 05:49:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (21 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (841 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.36% (10.5034 => 10.0452, std. dev.: 0.0132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.08% (0.3543 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.97% (0.3473 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3543 => 0.3783, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.77% (0.3516 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3497 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.68% (0.3561 => 0.3799, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3694 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.39% (0.3927 => 0.4178, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.18% (0.3886 => 0.4126, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5925 => 0.6128, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.28% (0.6030 => 0.6228, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.76% (0.7326 => 0.7528, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.8172 => 0.8359, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1067, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2842 => 1.3049, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (5.0018 => 5.0655, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.2646 => 4.3137, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.9449 => 5.0006, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 1.06% (3.8723 => 3.9132, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.51% (26.0924 => 26.7461, std. dev.: 0.0235) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.22% (0.8651 => 0.7334, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.85% (5.2763 => 4.8095, std. dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (2.9384 => 2.6944, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.75% (1.1194 => 1.0438, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4846, std. dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.19% (5.3526 => 5.1283, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.96% (6.6874 => 6.4225, std. dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: -3.11% (10.3673 => 10.0452, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (5.3855 => 5.2358, std. dev.: 0.0202) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (2.2022 => 2.1611, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 01:24:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 03:24:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620082418.5DBAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1286?compare_to=1284&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1286, Order: 158794, Start Time: 2012-06-20 07:28:39, End Time: 2012-06-20 08:25:45 To: 1284, Order: 158789, Start Time: 2012-06-20 05:57:41, End Time: 2012-06-20 06:54:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (2.0938 => 2.1167, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.15% (2.0176 => 2.2829, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (0.4328 => 0.4655, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2945 => 0.3160, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4062 => 0.4353, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.5818 => 0.6234, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.2966 => 0.3177, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.88% (0.2760 => 0.2950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1167, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.66% (0.5748 => 0.6131, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.50% (0.7061 => 0.7520, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.14% (0.3485 => 0.3699, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2988 => 0.3169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.82% (0.3489 => 0.3692, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.77% (0.3534 => 0.3738, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.76% (1.2292 => 1.3000, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.3293 => 0.3476, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.53% (1.3693 => 1.4450, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.7710 => 0.8112, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5265 => 0.5525, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1574, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.6959 => 0.7288, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.37% (0.3663 => 0.3823, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.36% (0.3646 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.34% (0.3914 => 0.4084, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 4.33% (0.3601 => 0.3757, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.33% (0.3789 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.30% (0.4003 => 0.4175, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3755 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.17% (0.3623 => 0.3774, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.11% (0.3650 => 0.3800, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.01% (0.3940 => 0.4098, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.74% (16.6129 => 17.2336, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 3.66% (1.0594 => 1.0982, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5637 => 0.5842, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.53% (13.8202 => 14.3075, std. dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7038 => 0.7277, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.38% (2.1791 => 2.2528, std. dev.: 0.0143) MultiSource/Applications/treecc/treecc: 3.26% (1.9270 => 1.9899, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (3.8646 => 3.9906, std. dev.: 0.0157) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1411, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.11% (1.2193 => 1.2572, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (13.2842 => 13.6968, std. dev.: 0.1053) MultiSource/Applications/spiff/spiff: 3.10% (0.7506 => 0.7739, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5015, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8310 => 0.8562, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (1.1364 => 1.1706, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7460 => 0.7667, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (1.3813 => 1.4168, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (7.2180 => 7.3921, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.33% (0.4379 => 0.4481, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.04% (0.6135 => 0.6260, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (3.6692 => 3.7421, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 1.94% (14.8535 => 15.1414, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.4433 => 4.5293, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.85% (4.3801 => 4.4612, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.62% (6.5754 => 6.6816, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2346, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 1.28% (14.5298 => 14.7164, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4570, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1240, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3082, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.2749 => 1.2880, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.30% (0.9996 => 1.0826, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 8.21% (1.2998 => 1.4065, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7210, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5841, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.68% (4.5928 => 4.7160, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1340, std. dev.: 0.0179) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9423, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.38% (0.8818 => 0.8520, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.89% (0.9108 => 0.8936, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.69% (2.6470 => 2.5493, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5793, std. dev.: 0.0352) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -2.28% (9.3358 => 9.1233, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9444, std. dev.: 0.0409) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6971, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2370, std. dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 01:38:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 03:38:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620083847.237E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1287?compare_to=1283&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1287, Order: 158792, Start Time: 2012-06-20 06:21:57, End Time: 2012-06-20 08:40:14 To: 1283, Order: 158786, Start Time: 2012-06-20 03:39:48, End Time: 2012-06-20 05:55:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Unchanged Tests: 894 (835 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.86% (0.3488 => 0.3797, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 8.80% (0.3465 => 0.3770, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 8.76% (0.3446 => 0.3748, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 8.70% (0.3496 => 0.3800, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3442 => 0.3741, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3469 => 0.3768, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3460 => 0.3757, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3643 => 0.3943, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 8.22% (0.3650 => 0.3950, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.3724 => 0.4030, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 4.05% (0.5826 => 0.6062, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.5889 => 0.6116, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2813 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.42% (2.0673 => 2.1381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3267 => 0.3378, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.38% (0.3348 => 0.3461, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3362 => 0.3472, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.4146 => 0.4279, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.14% (0.5900 => 0.6085, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.00% (0.7171 => 0.7386, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (0.4251 => 0.4372, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (1.6211 => 1.6657, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (0.5026 => 0.5164, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (3.5627 => 3.6600, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (1.3152 => 1.3483, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.49% (1.9694 => 2.0184, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.43% (4.2109 => 4.3133, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (0.4994 => 0.5115, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6435 => 0.6590, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.40% (1.9966 => 2.0445, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.14% (0.5000 => 0.5107, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.04% (5.5417 => 5.6546, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (2.7292 => 2.7836, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.78% (1.5932 => 1.6215, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.76% (0.9697 => 0.9868, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.66% (4.6177 => 4.6945, std. dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (2.1653 => 2.2005, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.59% (1.0781 => 1.0952, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (4.4195 => 4.4884, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.40% (1.8794 => 1.9057, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.38% (0.7875 => 0.7984, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.23% (1.4269 => 1.4445, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.18% (11.9555 => 12.0968, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std. dev.: 0.0019) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 01:46:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 03:46:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620084602.DD6742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1288?compare_to=1285&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1288, Order: 158796, Start Time: 2012-06-20 07:46:40, End Time: 2012-06-20 08:47:30 To: 1285, Order: 158792, Start Time: 2012-06-20 06:16:39, End Time: 2012-06-20 07:19:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 6 (41 on baseline) Performance Improvements: 2 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 865 (821 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (10.0452 => 10.4737, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (2.1067 => 2.1348, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.3049 => 1.3188, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 27.92% (6.9063 => 8.8345, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 2.26% (1.1027 => 1.1276, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 1.31% (7.9432 => 8.0471, std. dev.: 0.0196) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (5.2358 => 5.1823, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.42% (2.2997 => 2.2671, std. dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.15% (0.3473 => 0.3756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3543 => 0.3823, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.88% (0.3516 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3543 => 0.3810, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.37% (0.3828 => 0.4110, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.13% (0.3886 => 0.4163, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.10% (0.3927 => 0.4206, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.25% (0.5925 => 0.6177, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 4.16% (0.6030 => 0.6281, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.4289 => 0.4438, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 3.41% (0.7326 => 0.7576, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (2.0665 => 2.1348, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.4203 => 0.4318, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.69% (1.2842 => 1.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.8172 => 0.8388, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4636 => 0.4746, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.4620 => 0.4728, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (5.0018 => 5.0701, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3189, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.24% (4.9449 => 5.0062, std. dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (10.3673 => 10.4737, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (10.4361 => 10.5411, std. dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.41% (26.0924 => 26.7216, std. dev.: 0.0400) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.24% (0.8651 => 0.7333, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.32% (5.2763 => 4.7845, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (2.9384 => 2.6930, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (1.1194 => 1.0439, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4844, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.28% (6.6874 => 6.4011, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.77% (5.3855 => 5.1823, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.35% (5.3526 => 5.1734, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -2.16% (22.1758 => 21.6964, std. dev.: 0.0278) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (2.2022 => 2.1674, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.23% (1.7609 => 1.7393, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 02:48:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 04:48:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620094810.688DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1289?compare_to=1286&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1289, Order: 158797, Start Time: 2012-06-20 08:52:42, End Time: 2012-06-20 09:49:37 To: 1286, Order: 158794, Start Time: 2012-06-20 07:28:39, End Time: 2012-06-20 08:25:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2824, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 7.13% (0.2945 => 0.3155, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (0.4328 => 0.4634, std. dev.: 0.0110) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.2937 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.5818 => 0.6208, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (1.9828 => 2.1128, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7061 => 0.7507, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.99% (0.2988 => 0.3167, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3192 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.7710 => 0.8144, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2292 => 1.2980, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.33% (1.3693 => 1.4423, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.6959 => 0.7293, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (3.9660 => 4.1559, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5265 => 0.5506, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 4.25% (0.3578 => 0.3730, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.21% (0.3755 => 0.3913, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.16% (0.9199 => 0.9582, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 4.04% (0.3914 => 0.4072, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.00% (0.3646 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.00% (0.4003 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.99% (0.3789 => 0.3940, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 3.97% (0.3601 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.93% (0.3663 => 0.3807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.81% (0.3623 => 0.3761, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.78% (16.6129 => 17.2416, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 3.73% (0.3940 => 0.4087, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.73% (0.3650 => 0.3786, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.59% (1.0594 => 1.0974, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5637 => 0.5834, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.46% (13.8202 => 14.2977, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.7038 => 0.7280, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.30% (2.1791 => 2.2511, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (3.8646 => 3.9909, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9878, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.4563 => 1.5019, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.2193 => 1.2571, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.96% (0.7506 => 0.7728, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.95% (1.1061 => 1.1387, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (13.2842 => 13.6620, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.3813 => 1.4170, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.3819 => 1.4156, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (7.2180 => 7.3651, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (3.6692 => 3.7415, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.93% (14.8535 => 15.1406, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1542, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.3801 => 4.4583, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.4433 => 4.5174, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (6.5754 => 6.6734, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.30% (3.1889 => 3.2305, std. dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4479, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 1.13% (14.5298 => 14.6934, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (2.1007 => 2.1227, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.21% (0.9996 => 1.0817, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3980, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7360, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9622, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.84% (7.9275 => 8.1526, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7139, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9228, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.98% (0.3511 => 0.3266, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.8818 => 0.8515, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.93% (0.6576 => 0.6383, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.40% (20.3410 => 19.8519, std. dev.: 0.0816) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1143, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.24% (8.8259 => 8.6280, std. dev.: 0.0136) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.58% (2.5254 => 2.4855, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2338, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.19% (0.9692 => 0.9577, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 03:13:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 05:13:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620101336.986F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1290?compare_to=1288&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1290, Order: 158797, Start Time: 2012-06-20 09:14:31, End Time: 2012-06-20 10:15:03 To: 1288, Order: 158796, Start Time: 2012-06-20 07:46:40, End Time: 2012-06-20 08:47:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (831 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (10.4737 => 10.5950, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.92% (0.3473 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3497 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3516 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.54% (0.3543 => 0.3810, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3561 => 0.3829, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3694 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3543 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3828 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.79% (0.3886 => 0.4150, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.75% (0.3927 => 0.4192, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.92% (0.5925 => 0.6157, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 3.68% (0.6030 => 0.6252, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3232 => 0.3332, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 3.07% (0.7326 => 0.7551, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (2.0665 => 2.1241, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 2.54% (0.4048 => 0.4151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.40% (0.4203 => 0.4304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.8172 => 0.8352, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (10.3673 => 10.5950, std. dev.: 0.0094) MultiSource/Applications/spiff/spiff: 1.57% (0.7835 => 0.7958, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.9449 => 5.0075, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3177, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0556, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.04% (2.0273 => 2.0483, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.00% (10.4361 => 10.5408, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.48% (26.0924 => 26.7394, std. dev.: 0.0222) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.29% (0.8651 => 0.7328, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7842, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.51% (2.9384 => 2.6884, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (1.1194 => 1.0440, std. dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4603, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.26% (6.6874 => 6.4026, std. dev.: 0.0238) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.78% (5.3855 => 5.1817, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.48% (5.3526 => 5.1665, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -2.37% (22.1758 => 21.6508, std. dev.: 0.0201) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (2.2022 => 2.1641, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (1.7609 => 1.7399, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 04:11:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 06:11:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620111149.60CC62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1291?compare_to=1289&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1291, Order: 158801, Start Time: 2012-06-20 10:16:29, End Time: 2012-06-20 11:13:17 To: 1289, Order: 158797, Start Time: 2012-06-20 08:52:42, End Time: 2012-06-20 09:49:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.60% (2.0176 => 2.2719, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.83% (0.2945 => 0.3146, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.66% (0.2628 => 0.2803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.5818 => 0.6205, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5748 => 0.6125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2726 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.36% (0.7061 => 0.7510, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.27% (1.9828 => 2.1072, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3485 => 0.3690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.41% (1.2292 => 1.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.20% (0.3868 => 0.4069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.7710 => 0.8109, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.11% (1.3693 => 1.4393, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.55% (3.9660 => 4.1464, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.5265 => 0.5504, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.6959 => 0.7262, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.05% (0.3578 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.04% (0.3914 => 0.4072, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.9199 => 0.9564, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.3245 => 1.3762, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 3.89% (0.3646 => 0.3788, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.89% (0.3601 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.88% (0.3789 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.82% (0.3663 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.80% (0.4003 => 0.4155, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.73% (0.3623 => 0.3758, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.64% (0.3650 => 0.3783, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 3.63% (0.3940 => 0.4083, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.61% (13.8202 => 14.3194, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 3.50% (16.6129 => 17.1937, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5015, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.07% (0.7038 => 0.7254, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2456, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9813, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.2193 => 1.2560, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8698 => 0.8958, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 2.94% (1.9270 => 1.9836, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.87% (1.1364 => 1.1690, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.87% (1.1061 => 1.1378, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.86% (0.7506 => 0.7721, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (13.2842 => 13.6323, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.23% (1.3813 => 1.4121, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (7.2180 => 7.3592, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7385, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1077, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.3801 => 4.4550, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6283 => 0.6389, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.67% (1.1333 => 1.1522, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.4433 => 4.5123, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (6.5754 => 6.6630, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2235, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1220, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.00% (14.5298 => 14.6755, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0102) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7180, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.78% (12.4560 => 12.9273, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5170, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5846, std. dev.: 0.0380) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7167, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1363, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0061) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5078, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9564, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.8818 => 0.8513, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.42% (0.6576 => 0.6351, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.93% (0.9108 => 0.8932, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5738, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1096, std. dev.: 0.0124) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9173, std. dev.: 0.0392) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2345, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 04:21:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 06:21:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620112123.2CDEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1292?compare_to=1287&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1292, Order: 158797, Start Time: 2012-06-20 09:07:15, End Time: 2012-06-20 11:22:51 To: 1287, Order: 158792, Start Time: 2012-06-20 06:21:57, End Time: 2012-06-20 08:40:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (78 on baseline) Performance Improvements: 1 (0 on baseline) Unchanged Tests: 889 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.88% (0.9868 => 1.0054, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (2.1381 => 2.1662, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.0233 => 1.0352, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.02% (24.0937 => 24.3395, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.11% (2.5112 => 2.4582, std. dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.84% (0.3460 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.79% (0.3446 => 0.3749, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.77% (0.3442 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.77% (0.3465 => 0.3769, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.75% (0.3496 => 0.3802, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3469 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.54% (0.3488 => 0.3786, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 8.54% (0.3643 => 0.3954, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.44% (0.3650 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.3724 => 0.4031, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.39% (0.2729 => 0.2876, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2875 => 0.3029, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.33% (0.2813 => 0.2963, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2738 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.33% (0.3096 => 0.3261, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2803 => 0.2945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.96% (0.5826 => 0.6115, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.91% (0.2750 => 0.2885, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.78% (2.0673 => 2.1662, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3317 => 0.3474, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.73% (0.2792 => 0.2924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.71% (0.2911 => 0.3048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.70% (0.3678 => 0.3851, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.69% (0.5889 => 0.6165, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.68% (0.3267 => 0.3420, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3258 => 0.3409, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.62% (0.2811 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.54% (0.3477 => 0.3635, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3195 => 0.3338, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.47% (0.9909 => 1.0352, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.42% (0.3348 => 0.3496, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.32% (0.3124 => 0.3259, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.3625 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3690 => 0.3847, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.22% (0.3060 => 0.3189, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (0.4251 => 0.4426, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.5900 => 0.6140, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3282 => 0.3415, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4146 => 0.4310, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 3.83% (0.7171 => 0.7446, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.77% (0.3981 => 0.4131, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.75% (0.3845 => 0.3989, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.68% (0.9697 => 1.0054, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (1.6211 => 1.6785, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (0.5026 => 0.5202, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.48% (23.5202 => 24.3395, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (3.5627 => 3.6860, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (0.4994 => 0.5164, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.30% (1.3152 => 1.3586, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.5012 => 0.5177, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (1.9694 => 2.0303, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.02% (1.9966 => 2.0569, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.92% (0.5000 => 0.5146, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.91% (4.2109 => 4.3336, std. dev.: 0.0136) MultiSource/Applications/spiff/spiff: 2.85% (0.4029 => 0.4144, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (0.3930 => 0.4042, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.57% (5.5417 => 5.6839, std. dev.: 0.0141) MultiSource/Applications/d/make_dparser: 2.50% (1.0781 => 1.1050, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.49% (4.6177 => 4.7328, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (2.7292 => 2.7954, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (0.4361 => 0.4465, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (2.1653 => 2.2150, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (4.4195 => 4.5195, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 2.11% (0.7875 => 0.8041, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (2.1013 => 2.1444, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 2.00% (1.5932 => 1.6251, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.88% (11.9555 => 12.1806, std. dev.: 0.0099) MultiSource/Applications/lua/lua: 1.84% (1.4269 => 1.4532, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.80% (1.8794 => 1.9133, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 1.57% (0.6634 => 0.6738, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (11.6398 => 11.7947, std. dev.: 0.0101) Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 04:44:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 06:44:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620114417.9487F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1293?compare_to=1290&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1293, Order: 158808, Start Time: 2012-06-20 10:45:00, End Time: 2012-06-20 11:45:45 To: 1290, Order: 158797, Start Time: 2012-06-20 09:14:31, End Time: 2012-06-20 10:15:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (838 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.72% (0.3473 => 0.3741, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3497 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.51% (0.3543 => 0.3809, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3543 => 0.3799, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3828 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.80% (0.3927 => 0.4194, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.72% (0.3886 => 0.4147, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5925 => 0.6124, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 3.32% (0.6030 => 0.6230, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4289 => 0.4406, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.65% (0.7326 => 0.7520, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.65% (2.0665 => 2.1212, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (10.3673 => 10.6016, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2842 => 1.3112, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.54% (4.2646 => 4.3302, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.53% (0.7835 => 0.7955, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.24% (4.9449 => 5.0061, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.10% (2.0273 => 2.0497, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0560, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.02% (1.5603 => 1.5762, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7736, std. dev.: 0.0218) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.30% (0.8651 => 0.7327, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7869, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.74% (2.9384 => 2.6815, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (1.1194 => 1.0406, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2930, std. dev.: 0.0580) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.34% (6.6874 => 6.3974, std. dev.: 0.0293) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.01% (5.3855 => 5.1696, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.67% (5.3526 => 5.1560, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -2.24% (22.1758 => 21.6801, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.22% (2.2022 => 2.1533, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 05:35:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 07:35:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620123524.EE9E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1294?compare_to=1291&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1294, Order: 158813, Start Time: 2012-06-20 11:40:06, End Time: 2012-06-20 12:36:52 To: 1291, Order: 158801, Start Time: 2012-06-20 10:16:29, End Time: 2012-06-20 11:13:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (736 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2635, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2655 => 0.2861, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 7.06% (0.2945 => 0.3153, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.66% (0.2628 => 0.2803, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (1.9828 => 2.1110, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.40% (0.3453 => 0.3674, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3107 => 0.3302, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.02% (0.5748 => 0.6094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.88% (0.7061 => 0.7476, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.4016 => 0.4249, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.53% (1.2292 => 1.2972, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.46% (0.3868 => 0.4079, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.7710 => 0.8115, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.09% (1.3693 => 1.4390, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5265 => 0.5507, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (3.9660 => 4.1472, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.47% (0.6959 => 0.7270, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.06% (0.3789 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.06% (0.3646 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.01% (0.3914 => 0.4071, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.00% (0.3601 => 0.3745, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 3.99% (0.3663 => 0.3809, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3766, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 3.90% (0.4003 => 0.4159, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5637 => 0.5849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.76% (0.3940 => 0.4088, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.63% (16.6129 => 17.2153, std. dev.: 0.0168) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.56% (0.3650 => 0.3780, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3013, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 3.41% (1.0594 => 1.0955, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.27% (0.7038 => 0.7268, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.22% (3.8646 => 3.9889, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 3.21% (2.1791 => 2.2490, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9879, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.2193 => 1.2578, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.4563 => 1.5007, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.97% (0.7506 => 0.7729, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.95% (1.1061 => 1.1387, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (13.2842 => 13.6654, std. dev.: 0.0165) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.3819 => 1.4144, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3702, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (3.6692 => 3.7332, std. dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.1333 => 1.1526, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4526, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.65% (14.8535 => 15.0986, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.4433 => 4.5159, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6718, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2285, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 1.22% (14.5298 => 14.7075, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4036, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7306, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1438, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.72% (4.5928 => 4.7177, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.38% (0.4657 => 0.3894, std. dev.: 0.0290) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.29% (0.3511 => 0.3255, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9376, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.75% (0.8818 => 0.8487, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.6576 => 0.6407, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.03% (0.9108 => 0.8923, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.51% (9.3358 => 9.1017, std. dev.: 0.0361) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9125, std. dev.: 0.0220) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7007, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5156, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.59% (3.9173 => 3.8550, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2262, std. dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 06:12:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 08:12:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620131209.114D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1295?compare_to=1293&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1295, Order: 158815, Start Time: 2012-06-20 12:12:46, End Time: 2012-06-20 13:13:36 To: 1293, Order: 158808, Start Time: 2012-06-20 10:45:00, End Time: 2012-06-20 11:45:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (836 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.87% (0.3543 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3473 => 0.3743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.52% (0.3497 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3516 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3543 => 0.3806, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3828 => 0.4098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.85% (0.3927 => 0.4196, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.72% (0.3886 => 0.4147, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.40% (0.8172 => 0.8450, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 3.39% (0.5925 => 0.6126, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.25% (0.6030 => 0.6226, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.17% (0.7326 => 0.7558, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.61% (2.0665 => 2.1204, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2842 => 1.3122, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (10.3673 => 10.5889, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 1.57% (0.7835 => 0.7958, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2646 => 4.3244, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.9765 => 0.9896, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (4.9449 => 5.0086, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (5.0018 => 5.0632, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.03% (2.0273 => 2.0482, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7504, std. dev.: 0.0277) MultiSource/Benchmarks/llubenchmark/llu: 1.57% (3.7781 => 3.8373, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.3045 => 1.3210, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.14% (0.8651 => 0.7341, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7884, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.68% (2.9384 => 2.6834, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (1.1194 => 1.0406, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3264, std. dev.: 0.1099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.33% (6.6874 => 6.3978, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.04% (5.3855 => 5.1679, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.63% (5.3526 => 5.1585, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -2.23% (22.1758 => 21.6823, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.22% (2.2022 => 2.1533, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 06:59:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 08:59:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620135900.CD15F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1296?compare_to=1294&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1296, Order: 158819, Start Time: 2012-06-20 13:03:43, End Time: 2012-06-20 14:00:28 To: 1294, Order: 158813, Start Time: 2012-06-20 11:40:06, End Time: 2012-06-20 12:36:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2635, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.35% (0.4328 => 0.4646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 7.06% (0.2945 => 0.3153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.83% (0.2607 => 0.2785, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.66% (0.2628 => 0.2803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (1.9828 => 2.1114, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.40% (0.3453 => 0.3674, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.36% (0.5818 => 0.6188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.95% (0.5748 => 0.6090, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.85% (0.7061 => 0.7474, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.64% (0.3580 => 0.3782, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.43% (1.2292 => 1.2960, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.7710 => 0.8127, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.05% (1.3693 => 1.4385, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5265 => 0.5507, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.50% (3.9660 => 4.1444, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.45% (0.6959 => 0.7269, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.22% (0.3578 => 0.3729, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.14% (0.3646 => 0.3797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.10% (0.3663 => 0.3813, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.09% (0.9199 => 0.9575, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.06% (0.3914 => 0.4073, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.00% (0.3601 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.96% (0.3789 => 0.3939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (1.3245 => 1.3768, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 3.92% (0.4003 => 0.4160, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 3.86% (0.3623 => 0.3763, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.5637 => 0.5848, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 3.73% (0.3940 => 0.4087, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.56% (0.3650 => 0.3780, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.52% (16.6129 => 17.1985, std. dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3011, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.36% (1.1061 => 1.1433, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.28% (0.7506 => 0.7752, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5577 => 0.5759, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 3.24% (0.7038 => 0.7266, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.4563 => 1.5024, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 3.15% (3.8646 => 3.9863, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8698 => 0.8969, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.10% (1.9270 => 1.9868, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 3.10% (2.1791 => 2.2466, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.09% (1.2193 => 1.2570, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1364 => 1.1689, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.82% (13.2842 => 13.6583, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.7460 => 0.7644, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.20% (1.3813 => 1.4117, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.4791 => 0.4896, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4107, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3681, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.77% (14.8535 => 15.1170, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.71% (3.6692 => 3.7318, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1333 => 1.1523, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4526, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5154, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (6.5754 => 6.6636, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2269, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1241, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.09% (14.5298 => 14.6883, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.21% (2.0200 => 2.1859, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7306, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.98% (7.9275 => 8.1638, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5840, std. dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.52% (4.5928 => 4.7086, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.2308 => 1.2438, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9290 => 1.9486, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.90% (0.4657 => 0.3963, std. dev.: 0.0240) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9357, std. dev.: 0.0215) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.18% (0.3511 => 0.3259, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.8818 => 0.8491, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.03% (0.9108 => 0.8923, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5822, std. dev.: 0.0249) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1005, std. dev.: 0.0140) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9576, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6988, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5123, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9779, std. dev.: 0.0533) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2586, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2512, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2426, std. dev.: 0.0281) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 07:03:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 09:03:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620140342.BB6252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1297?compare_to=1292&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1297, Order: 158813, Start Time: 2012-06-20 11:49:38, End Time: 2012-06-20 14:05:09 To: 1292, Order: 158797, Start Time: 2012-06-20 09:07:15, End Time: 2012-06-20 11:22:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (72 on baseline) Performance Improvements: 3 (0 on baseline) Unchanged Tests: 890 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.95% (2.0519 => 2.0919, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.63% (1.0054 => 0.9890, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.07% (2.1662 => 2.1431, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.0352 => 1.0246, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3446 => 0.3738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.46% (0.3465 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.44% (0.3460 => 0.3752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.44% (0.3496 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.37% (0.3442 => 0.3730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3469 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.11% (0.3650 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3643 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.06% (0.3488 => 0.3769, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3724 => 0.4016, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2875 => 0.2995, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 4.12% (0.5826 => 0.6066, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2803 => 0.2914, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 3.77% (0.5889 => 0.6111, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (2.0673 => 2.1431, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.51% (0.5900 => 0.6107, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 3.50% (0.3004 => 0.3109, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (0.5026 => 0.5201, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (0.3625 => 0.3751, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3258 => 0.3371, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.40% (0.7171 => 0.7415, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.40% (0.9909 => 1.0246, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.38% (0.3348 => 0.3461, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (3.5627 => 3.6822, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3195 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3690 => 0.3813, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (1.6211 => 1.6747, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.4251 => 0.4384, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.13% (1.9694 => 2.0310, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (1.3152 => 1.3559, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.07% (23.5202 => 24.2434, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.92% (1.9966 => 2.0550, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.88% (0.4029 => 0.4145, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.84% (0.4994 => 0.5136, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (0.3930 => 0.4041, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.81% (4.2109 => 4.3293, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.55% (0.5012 => 0.5140, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.52% (0.5000 => 0.5126, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.43% (4.6177 => 4.7299, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.6435 => 0.6591, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.42% (1.0781 => 1.1042, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.35% (5.5417 => 5.6720, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.35% (2.1653 => 2.2161, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.27% (2.7292 => 2.7911, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (4.4195 => 4.5152, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.07% (0.7875 => 0.8038, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.99% (0.9697 => 0.9890, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (1.8794 => 1.9159, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.90% (1.4269 => 1.4540, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.86% (2.1013 => 2.1403, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.85% (1.5932 => 1.6227, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.47% (11.9555 => 12.1310, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std. dev.: 0.0022) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 07:39:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 09:39:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620143950.17B382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1298?compare_to=1295&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1298, Order: 158819, Start Time: 2012-06-20 13:40:30, End Time: 2012-06-20 14:41:17 To: 1295, Order: 158815, Start Time: 2012-06-20 12:12:46, End Time: 2012-06-20 13:13:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (23 on baseline) Performance Improvements: 1 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (840 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.76% (3.8373 => 3.7698, std. dev.: 0.0235) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.65% (0.3543 => 0.3814, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 7.50% (0.3561 => 0.3828, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.49% (0.3497 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.45% (0.3543 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3516 => 0.3774, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3694 => 0.3963, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3828 => 0.4092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.3927 => 0.4191, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.64% (0.3886 => 0.4144, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5925 => 0.6125, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.33% (0.6030 => 0.6231, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.8172 => 0.8407, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: 2.70% (0.7326 => 0.7524, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (2.0665 => 2.1217, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (10.3673 => 10.5919, std. dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 2.16% (1.2842 => 1.3119, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (4.2646 => 4.3231, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.9449 => 5.0003, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (5.0018 => 5.0552, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.04% (2.0273 => 2.0484, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7432, std. dev.: 0.0343) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.29% (0.8651 => 0.7328, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7867, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.74% (2.9384 => 2.6816, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (1.1194 => 1.0410, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.34% (54.1659 => 51.2716, std. dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.34% (6.6874 => 6.3969, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.92% (5.3855 => 5.1742, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.57% (5.3526 => 5.1614, std. dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: -2.34% (22.1758 => 21.6558, std. dev.: 0.0194) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.18% (2.2022 => 2.1541, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 09:16:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 11:16:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620161606.5206C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1299?compare_to=1296&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1299, Order: 158820, Start Time: 2012-06-20 15:20:45, End Time: 2012-06-20 16:17:33 To: 1296, Order: 158819, Start Time: 2012-06-20 13:03:43, End Time: 2012-06-20 14:00:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.15% (2.0176 => 2.2627, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.06% (0.2945 => 0.3153, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4062 => 0.4348, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.83% (0.2782 => 0.2972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.50% (1.9828 => 2.1117, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.38% (0.2696 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3107 => 0.3302, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.17% (0.3485 => 0.3700, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5748 => 0.6091, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7061 => 0.7480, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.4016 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.57% (1.2292 => 1.2977, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.7710 => 0.8139, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 5.51% (0.3868 => 0.4081, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3756 => 0.3958, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.26% (1.3693 => 1.4413, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.73% (0.5265 => 0.5514, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (3.9660 => 4.1525, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.6959 => 0.7280, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.9199 => 0.9585, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.14% (0.3578 => 0.3726, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3789, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.04% (0.3663 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.04% (0.3914 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.03% (0.3646 => 0.3793, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.00% (0.3601 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.99% (0.3789 => 0.3940, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 3.95% (0.4003 => 0.4161, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.76% (0.3940 => 0.4088, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.75% (0.3623 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.63% (16.6129 => 17.2160, std. dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 3.57% (13.8202 => 14.3139, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.53% (0.3650 => 0.3779, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.52% (0.7038 => 0.7286, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0594 => 1.0963, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (3.8646 => 3.9908, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 3.24% (1.1061 => 1.1419, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.17% (1.9270 => 1.9881, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.17% (2.1791 => 2.2481, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2579, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.13% (0.7506 => 0.7741, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.4563 => 1.5011, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (13.2842 => 13.6670, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.7460 => 0.7652, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4379 => 0.4479, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4120, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (1.3819 => 1.4118, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (7.2180 => 7.3723, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6135 => 0.6266, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (3.6692 => 3.7380, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.87% (14.8535 => 15.1317, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.3801 => 4.4568, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6283 => 0.6390, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.4433 => 4.5186, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6719, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2318, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 1.12% (14.5298 => 14.6919, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5167, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.95% (7.9275 => 8.1610, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7143, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.07% (0.4657 => 0.3862, std. dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.23% (0.3511 => 0.3257, std. dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9726, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.8818 => 0.8491, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.90% (0.9108 => 0.8935, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0099) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1101, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6143, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9559, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4867 => 0.4763, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9076, std. dev.: 0.0273) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6983, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2364, std. dev.: 0.0186) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 09:23:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 11:23:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620162307.46C522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1300?compare_to=1298&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1300, Order: 158820, Start Time: 2012-06-20 15:23:50, End Time: 2012-06-20 16:24:35 To: 1298, Order: 158819, Start Time: 2012-06-20 13:40:30, End Time: 2012-06-20 14:41:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (26 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (837 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.57% (3.7698 => 3.8289, std. dev.: 0.0142) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.75% (0.3473 => 0.3742, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.51% (0.3543 => 0.3809, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3516 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.46% (0.3497 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.44% (0.3561 => 0.3826, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3828 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.3927 => 0.4193, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.72% (0.3886 => 0.4147, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5925 => 0.6125, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 3.25% (0.6030 => 0.6226, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.69% (0.7326 => 0.7523, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0665 => 2.1187, std. dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4636 => 0.4750, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (10.3673 => 10.5891, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3115, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.61% (1.1642 => 1.1830, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.43% (0.7835 => 0.7947, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.43% (4.2646 => 4.3255, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0129, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (5.0018 => 5.0642, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.06% (2.0273 => 2.0488, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.43% (26.0924 => 26.7262, std. dev.: 0.0218) MultiSource/Benchmarks/llubenchmark/llu: 1.34% (3.7781 => 3.8289, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.24% (0.8651 => 0.7333, std. dev.: 0.0281) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7868, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.78% (2.9384 => 2.6803, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (1.1194 => 1.0404, std. dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -5.36% (54.1659 => 51.2648, std. dev.: 0.0954) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.36% (6.6874 => 6.3959, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.91% (5.3855 => 5.1747, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.58% (5.3526 => 5.1612, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -2.32% (22.1758 => 21.6610, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.21% (2.2022 => 2.1535, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 09:45:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 11:45:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620164556.1ECA52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1301?compare_to=1297&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1301, Order: 158819, Start Time: 2012-06-20 14:31:55, End Time: 2012-06-20 16:47:23 To: 1297, Order: 158813, Start Time: 2012-06-20 11:49:38, End Time: 2012-06-20 14:05:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Unchanged Tests: 894 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.51% (0.3465 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3446 => 0.3739, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3460 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.45% (0.3442 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.44% (0.3496 => 0.3791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3469 => 0.3758, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.13% (0.3643 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.06% (0.3488 => 0.3769, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 8.05% (0.3650 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3724 => 0.4016, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2875 => 0.2993, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 4.05% (0.5826 => 0.6062, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.81% (2.0673 => 2.1460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.68% (0.5889 => 0.6106, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.62% (0.3317 => 0.3437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.58% (0.7171 => 0.7428, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.49% (0.9909 => 1.0255, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3267 => 0.3381, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3258 => 0.3371, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3348 => 0.3463, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.43% (0.3004 => 0.3107, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (0.5026 => 0.5195, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3690 => 0.3814, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (1.6211 => 1.6755, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (3.5627 => 3.6822, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.5900 => 0.6097, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3477 => 0.3593, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3726 => 0.3849, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.14% (23.5202 => 24.2591, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (1.9694 => 2.0309, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.11% (1.9966 => 2.0586, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.08% (0.3282 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (0.4994 => 0.5147, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4251 => 0.4380, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (1.3152 => 1.3551, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.90% (0.4029 => 0.4146, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (0.5000 => 0.5141, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.79% (4.2109 => 4.3285, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (0.3930 => 0.4039, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.56% (4.6177 => 4.7357, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.5012 => 0.5139, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.49% (1.0781 => 1.1049, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (2.1653 => 2.2174, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.38% (5.5417 => 5.6736, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.32% (2.7292 => 2.7926, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.20% (0.9697 => 0.9910, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (4.4195 => 4.5139, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.96% (0.7875 => 0.8029, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (2.1013 => 2.1418, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.83% (1.4269 => 1.4530, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.67% (0.6634 => 0.6745, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (1.8794 => 1.9100, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 1.46% (11.9555 => 12.1296, std. dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (11.6398 => 11.7646, std. dev.: 0.0052) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 10:40:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 12:40:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620174015.78C8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1302?compare_to=1299&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1302, Order: 158826, Start Time: 2012-06-20 16:44:45, End Time: 2012-06-20 17:41:43 To: 1299, Order: 158820, Start Time: 2012-06-20 15:20:45, End Time: 2012-06-20 16:17:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.35% (0.3862 => 0.4339, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.22% (2.1117 => 2.0859, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.5818 => 0.6225, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5748 => 0.6136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.40% (0.7061 => 0.7513, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3580 => 0.3745, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2852, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.2988 => 0.3121, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.44% (0.3578 => 0.3737, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.40% (1.3693 => 1.4296, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.30% (3.9660 => 4.1366, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.20% (0.3646 => 0.3799, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.19% (0.3601 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 4.15% (0.3663 => 0.3815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.14% (0.3914 => 0.4076, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.5265 => 0.5482, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 4.09% (0.3789 => 0.3944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.05% (0.6959 => 0.7241, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4390 => 0.4567, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 4.00% (0.3623 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.97% (0.4003 => 0.4162, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.86% (0.3940 => 0.4092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.75% (0.3650 => 0.3787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.75% (0.9199 => 0.9544, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.09% (13.8202 => 14.2468, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 3.06% (16.6129 => 17.1212, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (3.8646 => 3.9744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.2193 => 1.2539, std. dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 2.81% (0.7038 => 0.7236, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.4563 => 1.4965, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.73% (2.1791 => 2.2385, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.65% (0.5577 => 0.5725, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.61% (1.9270 => 1.9773, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.7460 => 0.7644, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6104, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: 2.40% (0.7506 => 0.7686, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4144, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4136, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.69% (7.2180 => 7.3402, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (3.6692 => 3.7311, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.68% (0.6135 => 0.6238, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.4433 => 4.5103, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.8535 => 15.0631, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.3801 => 4.4408, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6524, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0482) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.00% (0.9996 => 1.0796, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7354, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5190, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.84% (7.9275 => 8.1523, std. dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7140, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.62% (22.5627 => 20.8427, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.83% (0.4657 => 0.4339, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.79% (0.8818 => 0.8484, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.6576 => 0.6381, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.12% (0.9108 => 0.8915, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6080, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: -2.41% (9.3358 => 9.1107, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9582, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9561, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6974, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2367, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 10:51:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 12:51:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620175104.8200B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1303?compare_to=1300&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1303, Order: 158826, Start Time: 2012-06-20 16:51:32, End Time: 2012-06-20 17:52:31 To: 1300, Order: 158820, Start Time: 2012-06-20 15:23:50, End Time: 2012-06-20 16:24:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 9 (55 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 864 (808 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.21% (0.6026 => 0.6159, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.36% (1.0404 => 1.0545, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.8827 => 3.9275, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.10% (5.1747 => 5.2317, std. dev.: 0.0174) MultiSource/Applications/siod/siod: 1.07% (2.3094 => 2.3341, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (5.1612 => 5.2144, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.4325 => 1.4469, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.00% (1.1893 => 1.2012, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.30% (7.9478 => 8.0508, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3473 => 0.3743, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3561 => 0.3829, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3516 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.49% (0.3497 => 0.3759, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.48% (0.3543 => 0.3808, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3694 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.17% (0.3543 => 0.3797, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3828 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.95% (0.3927 => 0.4200, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.85% (0.3886 => 0.4152, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.22% (0.5925 => 0.6175, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 3.98% (0.6030 => 0.6270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.58% (0.7326 => 0.7588, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3441 => 0.3564, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5981 => 0.6159, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.8172 => 0.8402, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.67% (0.3935 => 0.4040, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.38% (0.4203 => 0.4303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4620 => 0.4729, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.35% (0.7835 => 0.8019, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.04% (4.2646 => 4.3514, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.9449 => 5.0402, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (10.3673 => 10.5651, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.83% (0.7115 => 0.7245, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 1.82% (2.0273 => 2.0642, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.79% (3.8723 => 3.9418, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.74% (0.5860 => 0.5962, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (5.0018 => 5.0860, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (2.2024 => 2.2381, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.62% (2.2969 => 2.3341, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.60% (1.5603 => 1.5852, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.57% (0.9765 => 0.9918, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.1861 => 1.2042, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.8101 => 0.8222, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 1.45% (0.7433 => 0.7541, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (1.1840 => 1.2012, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5633, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.40% (0.8067 => 0.8180, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (1.5859 => 1.6078, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (10.4361 => 10.5738, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 1.31% (3.3354 => 3.3792, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3050 => 1.3215, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 1.22% (0.8921 => 0.9030, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.1363 => 8.2265, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (9.4845 => 9.5837, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7573, std. dev.: 0.0243) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -14.65% (0.8651 => 0.7384, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.83% (5.2763 => 4.8104, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (2.9384 => 2.7039, std. dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.80% (1.1194 => 1.0545, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3730, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.89% (6.6874 => 6.4270, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.86% (5.3855 => 5.2317, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.58% (5.3526 => 5.2144, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -1.51% (22.1758 => 21.8413, std. dev.: 0.0244) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (2.2022 => 2.1724, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 12:03:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 14:03:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620190356.565502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1304?compare_to=1302&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1304, Order: 158829, Start Time: 2012-06-20 18:08:38, End Time: 2012-06-20 19:05:22 To: 1302, Order: 158826, Start Time: 2012-06-20 16:44:45, End Time: 2012-06-20 17:41:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.82% (2.0176 => 2.2762, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.03% (0.5818 => 0.6169, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.90% (0.5748 => 0.6087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4328 => 0.4580, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7061 => 0.7465, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.99% (0.2765 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.91% (1.9828 => 2.0801, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.7710 => 0.8076, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.6959 => 0.7259, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.27% (3.9660 => 4.1354, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: 4.24% (1.3693 => 1.4274, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.3192 => 0.3327, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.21% (0.3489 => 0.3636, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5265 => 0.5485, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.88% (0.3578 => 0.3717, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 3.81% (0.3914 => 0.4063, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.9199 => 0.9548, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.72% (0.3601 => 0.3735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.69% (0.3789 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.69% (0.3663 => 0.3798, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.65% (0.3646 => 0.3779, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4390 => 0.4550, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3721, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.59% (0.3623 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.55% (0.4003 => 0.4145, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 3.40% (0.3940 => 0.4074, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.26% (0.3650 => 0.3769, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.17% (13.8202 => 14.2587, std. dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 3.07% (16.6129 => 17.1233, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (3.8646 => 3.9765, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.7038 => 0.7239, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.2193 => 1.2536, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (1.4563 => 1.4972, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.74% (1.9270 => 1.9798, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2387, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.73% (0.5577 => 0.5729, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.64% (1.3813 => 1.4178, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.57% (1.3819 => 1.4174, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.57% (1.1061 => 1.1345, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.45% (0.7460 => 0.7643, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5994, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8698 => 0.8888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.69% (7.2180 => 7.3401, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7295, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 1.52% (14.8535 => 15.0793, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (4.3801 => 4.4364, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.21% (4.4433 => 4.4971, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6525, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.05% (3.1889 => 3.2224, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7339, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.84% (7.9275 => 8.1530, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7167, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.17% (13.3668 => 13.5236, std. dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std. dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8751, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.74% (0.8818 => 0.8488, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.6576 => 0.6372, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.10% (0.9108 => 0.8917, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.26% (9.3358 => 9.1249, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9366, std. dev.: 0.0358) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6975, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2491, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2515, std. dev.: 0.0171) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 12:19:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 14:19:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620191904.D052D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1305?compare_to=1303&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1305, Order: 158830, Start Time: 2012-06-20 18:19:40, End Time: 2012-06-20 19:20:32 To: 1303, Order: 158826, Start Time: 2012-06-20 16:51:32, End Time: 2012-06-20 17:52:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 1 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (10.5651 => 10.7847, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.03% (0.6159 => 0.6034, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.94% (0.3473 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3497 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3516 => 0.3751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.68% (0.3561 => 0.3799, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.66% (0.3543 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3543 => 0.3773, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3694 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.29% (0.3927 => 0.4174, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.07% (0.3886 => 0.4122, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 4.03% (10.3673 => 10.7847, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5925 => 0.6133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.30% (0.6030 => 0.6229, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7326 => 0.7539, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (2.0665 => 2.1147, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3089, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.83% (0.6456 => 0.6574, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (4.2646 => 4.3376, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 1.61% (0.7835 => 0.7961, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.39% (3.8723 => 3.9261, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (5.0018 => 5.0702, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0116, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.5415 => 1.5593, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 1.14% (10.4361 => 10.5554, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 1.10% (2.2969 => 2.3222, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.2024 => 2.2248, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.00% (1.1861 => 1.1980, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.40% (26.0924 => 26.7182, std. dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.39% (0.8651 => 0.7320, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.12% (5.2763 => 4.7953, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (2.9384 => 2.6902, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.50% (1.1194 => 1.0466, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.2993, std. dev.: 0.0604) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.36% (6.6874 => 6.3960, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.75% (5.3855 => 5.1838, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.47% (5.3526 => 5.1668, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -2.09% (22.1758 => 21.7131, std. dev.: 0.0225) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (2.2022 => 2.1634, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 12:28:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 14:28:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620192808.1274D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1306?compare_to=1301&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1306, Order: 158826, Start Time: 2012-06-20 17:14:07, End Time: 2012-06-20 19:29:35 To: 1301, Order: 158819, Start Time: 2012-06-20 14:31:55, End Time: 2012-06-20 16:47:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (43 on baseline) Performance Improvements: 2 (0 on baseline) Unchanged Tests: 892 (851 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.09% (1.6248 => 1.6071, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (2.1460 => 2.1243, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3446 => 0.3740, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3465 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3460 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.43% (0.3442 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.41% (0.3496 => 0.3790, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3469 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.08% (0.3650 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3643 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3488 => 0.3768, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3724 => 0.4017, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.5826 => 0.6082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.06% (0.5889 => 0.6128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.61% (0.7171 => 0.7430, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (0.5026 => 0.5189, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.19% (0.5900 => 0.6088, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.13% (1.6211 => 1.6719, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (3.5627 => 3.6727, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (1.3152 => 1.3537, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.78% (0.4994 => 0.5133, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (2.0673 => 2.1243, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.73% (0.4029 => 0.4139, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.70% (4.2109 => 4.3247, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 2.68% (0.9909 => 1.0175, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.61% (1.9694 => 2.0208, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.57% (0.3930 => 0.4031, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (1.9966 => 2.0479, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.48% (0.4146 => 0.4249, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.48% (23.5202 => 24.1025, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (0.5000 => 0.5118, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.16% (2.7292 => 2.7882, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.13% (4.6177 => 4.7159, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 2.00% (5.5417 => 5.6525, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.6435 => 0.6556, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (2.1653 => 2.2054, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (4.4195 => 4.5001, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.79% (1.0781 => 1.0974, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 1.69% (0.7875 => 0.8008, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (2.1013 => 2.1359, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.57% (0.9697 => 0.9849, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (1.8794 => 1.9086, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.43% (1.4269 => 1.4473, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.14% (11.9555 => 12.0922, std. dev.: 0.0136) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 13:27:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 15:27:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620202725.B86D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1307?compare_to=1304&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1307, Order: 158837, Start Time: 2012-06-20 19:32:15, End Time: 2012-06-20 20:28:51 To: 1304, Order: 158829, Start Time: 2012-06-20 18:08:38, End Time: 2012-06-20 19:05:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2639, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.5818 => 0.6158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.51% (0.5748 => 0.6065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7061 => 0.7429, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (0.4328 => 0.4537, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.7710 => 0.8069, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4062 => 0.4245, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.27% (0.3022 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.21% (3.9660 => 4.1331, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5265 => 0.5484, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.14% (0.6959 => 0.7247, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.13% (0.2782 => 0.2897, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.04% (1.3693 => 1.4246, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.02% (0.3578 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.01% (0.2966 => 0.3085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.96% (0.3789 => 0.3939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (1.9828 => 2.0604, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 3.91% (0.3914 => 0.4067, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.91% (0.2765 => 0.2873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.89% (0.3646 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.88% (0.3663 => 0.3805, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3149 => 0.3271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.86% (0.3601 => 0.3740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.80% (0.4003 => 0.4155, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 3.78% (0.3940 => 0.4089, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 3.77% (0.3107 => 0.3224, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.74% (0.3899 => 0.4045, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2292 => 1.2747, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 3.67% (0.3623 => 0.3756, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9199 => 0.9533, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.3489 => 0.3615, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (0.3485 => 0.3610, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.55% (1.3245 => 1.3715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3580 => 0.3707, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4016 => 0.4155, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.37% (0.3650 => 0.3773, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5637 => 0.5824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3192 => 0.3296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3534 => 0.3644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3293 => 0.3394, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (3.8646 => 3.9796, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2311, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.7038 => 0.7242, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.82% (0.4390 => 0.4514, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2535, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.78% (16.6129 => 17.0745, std. dev.: 0.0724) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2384, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.4563 => 1.4953, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.66% (1.9270 => 1.9783, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.56% (0.5577 => 0.5720, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5929, std. dev.: 0.0149) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4106, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.07% (1.3813 => 1.4099, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.58% (7.2180 => 7.3322, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.58% (0.8698 => 0.8835, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7216, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.1333 => 1.1485, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0441, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.25% (4.3801 => 4.4348, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (4.4433 => 4.4925, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.55% (1.8175 => 2.2819, std. dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1927, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9996 => 1.0799, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3940, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7326, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5185, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.96% (7.9275 => 8.1621, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 2.70% (4.5928 => 4.7168, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.37% (10.7476 => 10.8950, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.31% (1.9290 => 1.9542, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std. dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.01% (22.5627 => 20.7544, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3511 => 0.3262, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.67% (0.8818 => 0.8494, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.30% (0.6576 => 0.6425, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.25% (0.9108 => 0.8903, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.16% (33.2944 => 32.9089, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.9865 => 4.9338, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5748, std. dev.: 0.0207) MultiSource/Applications/minisat/minisat: -2.39% (9.3358 => 9.1123, std. dev.: 0.0454) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9065, std. dev.: 0.0701) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3305 => 7.1996, std. dev.: 0.0186) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5143, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 13:46:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 15:46:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620204659.BE6102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1308?compare_to=1305&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1308, Order: 158837, Start Time: 2012-06-20 19:47:33, End Time: 2012-06-20 20:48:28 To: 1305, Order: 158830, Start Time: 2012-06-20 18:19:40, End Time: 2012-06-20 19:20:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (55 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 870 (809 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (5.1668 => 5.2305, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.16% (5.1838 => 5.2437, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.30% (3.7548 => 3.8036, std. dev.: 0.0168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3473 => 0.3734, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3497 => 0.3756, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.39% (0.3543 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.27% (0.3561 => 0.3820, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.17% (0.3516 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.97% (0.3543 => 0.3790, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3828 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.70% (0.3927 => 0.4190, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 6.66% (0.3886 => 0.4145, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 4.84% (10.3673 => 10.8692, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 4.03% (0.5925 => 0.6164, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.88% (0.6030 => 0.6264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.82% (0.7326 => 0.7606, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.66% (0.8172 => 0.8471, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4615 => 0.4748, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.86% (0.4299 => 0.4422, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.48% (4.2646 => 4.3703, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5569 => 0.5702, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 2.34% (0.7835 => 0.8018, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (0.4620 => 0.4723, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5860 => 0.5986, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4485, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.9449 => 5.0484, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.08% (5.0018 => 5.1056, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (2.0665 => 2.1089, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.03% (2.0273 => 2.0684, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.5415 => 1.5724, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.94% (1.2842 => 1.3091, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.1840 => 1.2069, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.87% (2.2969 => 2.3398, std. dev.: 0.0091) MultiSource/Applications/hbd/hbd: 1.85% (1.5603 => 1.5892, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6450 => 0.6569, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.78% (3.8723 => 3.9414, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2068, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (2.2024 => 2.2408, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.8101 => 0.8241, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.72% (0.9765 => 0.9933, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.3050 => 1.3256, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.56% (3.3354 => 3.3874, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (9.4845 => 9.6323, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7433 => 0.7548, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (10.4361 => 10.5962, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.51% (1.5859 => 1.6098, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 1.45% (0.8921 => 0.9050, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2523, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.12% (14.3668 => 14.5271, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.8922 => 3.9335, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7917, std. dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.05% (0.8651 => 0.7349, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.51% (5.2763 => 4.8273, std. dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.81% (2.9384 => 2.7088, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (1.1194 => 1.0544, std. dev.: 0.0186) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4815, std. dev.: 0.0374) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.88% (6.6874 => 6.4276, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.63% (5.3855 => 5.2437, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.28% (5.3526 => 5.2305, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -1.20% (22.1758 => 21.9098, std. dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 14:52:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 16:52:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620215207.2A6972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1309?compare_to=1307&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1309, Order: 158842, Start Time: 2012-06-20 20:56:50, End Time: 2012-06-20 21:53:34 To: 1307, Order: 158837, Start Time: 2012-06-20 19:32:15, End Time: 2012-06-20 20:28:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (129 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (726 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0604 => 2.0995, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.29% (1.2747 => 1.2911, std. dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (2.2639 => 2.2882, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 1.05% (32.9089 => 33.2528, std. dev.: 0.0081) MultiSource/Applications/hbd/hbd: 1.02% (1.4246 => 1.4392, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.41% (2.0176 => 2.2882, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.55% (0.5818 => 0.6199, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 6.42% (0.2945 => 0.3134, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.32% (0.5748 => 0.6111, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4062 => 0.4318, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.93% (0.2765 => 0.2929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.89% (0.7061 => 0.7477, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.89% (1.9828 => 2.0995, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.45% (0.7710 => 0.8130, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.10% (1.3693 => 1.4392, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.04% (1.2292 => 1.2911, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (3.9660 => 4.1613, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.5265 => 0.5521, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.76% (0.6959 => 0.7290, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 4.75% (0.3578 => 0.3748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.64% (0.3646 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.59% (0.3789 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.58% (0.3601 => 0.3766, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.56% (0.3663 => 0.3830, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.55% (0.4003 => 0.4185, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.50% (0.3623 => 0.3786, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4390 => 0.4583, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.37% (0.3940 => 0.4112, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (0.9199 => 0.9584, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.14% (0.3650 => 0.3801, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.09% (1.3245 => 1.3787, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.86% (13.8202 => 14.3530, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7038 => 0.7299, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0977, std. dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 3.54% (16.6129 => 17.2013, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (3.8646 => 3.9970, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.42% (1.4563 => 1.5061, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.34% (2.1791 => 2.2518, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5577 => 0.5763, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.28% (1.9270 => 1.9903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.28% (1.2193 => 1.2593, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1364 => 1.1726, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8310 => 0.8570, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.07% (1.1061 => 1.1401, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.05% (0.7506 => 0.7735, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (13.2842 => 13.6559, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.8698 => 0.8930, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4156, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4379 => 0.4487, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.3819 => 1.4139, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6135 => 0.6275, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3814, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.13% (3.6692 => 3.7474, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.07% (14.8535 => 15.1613, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4650, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (4.4433 => 4.5277, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1541, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 1.71% (6.5754 => 6.6881, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 1.62% (3.1889 => 3.2406, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1274, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.5298 => 14.7114, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5188 => 1.5368, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4538, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std. dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.11% (0.9996 => 1.0807, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.37% (1.2998 => 1.3956, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7298, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5182, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5842, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1374, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7125, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2308 => 1.2463, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.31% (22.5627 => 20.9124, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.66% (0.3511 => 0.3277, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.32% (1.3780 => 1.3185, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6053, std. dev.: 0.0178) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1103, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9566, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.24% (0.4867 => 0.4758, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9330, std. dev.: 0.0554) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6993, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2539, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2290, std. dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 15:10:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 17:10:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120620221018.421362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1310?compare_to=1306&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1310, Order: 158837, Start Time: 2012-06-20 19:56:23, End Time: 2012-06-20 22:11:46 To: 1306, Order: 158826, Start Time: 2012-06-20 17:14:07, End Time: 2012-06-20 19:29:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (35 on baseline) Performance Improvements: 2 (1 on baseline) Unchanged Tests: 892 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.50% (12.0922 => 11.6686, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.07% (2.0479 => 2.0259, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.34% (0.3792 => 0.4260, std. dev.: 0.0181) SingleSource/UnitTests/ObjC/exceptions-2: 8.07% (0.3446 => 0.3724, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.05% (0.3465 => 0.3744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3496 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.01% (0.3460 => 0.3737, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.96% (0.3442 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.93% (0.3469 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.81% (0.3650 => 0.3935, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3488 => 0.3757, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.60% (0.3643 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.3724 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.55% (0.5826 => 0.6033, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.38% (0.5889 => 0.6088, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.5900 => 0.6097, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.14% (0.7171 => 0.7396, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (0.5026 => 0.5178, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (1.6211 => 1.6695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (3.5627 => 3.6636, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (1.3152 => 1.3523, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.72% (0.4994 => 0.5130, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.48% (0.4029 => 0.4129, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.40% (4.2109 => 4.3119, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (2.0673 => 2.1148, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.04% (2.7292 => 2.7850, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.84% (23.5202 => 23.9523, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (1.9694 => 2.0050, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (4.4195 => 4.4990, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (1.8794 => 1.9118, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.72% (1.0781 => 1.0966, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.59% (4.6177 => 4.6912, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (2.1013 => 2.1334, std. dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 1.52% (2.1653 => 2.1982, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (1.9966 => 2.0259, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.35% (5.5417 => 5.6163, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 1.07% (1.4269 => 1.4422, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.40% (11.9555 => 11.6686, std. dev.: 0.0133) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 15:16:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 17:16:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620221638.4AA7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1311?compare_to=1308&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1311, Order: 158846, Start Time: 2012-06-20 21:17:11, End Time: 2012-06-20 22:18:03 To: 1308, Order: 158837, Start Time: 2012-06-20 19:47:33, End Time: 2012-06-20 20:48:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (35 on baseline) Performance Improvements: 5 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 868 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.65% (10.8692 => 10.5808, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.56% (5.2305 => 5.1487, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.49% (5.2437 => 5.1654, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.24% (1.7676 => 1.7457, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.13% (2.1807 => 2.1561, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3473 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3497 => 0.3761, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.51% (0.3543 => 0.3809, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.50% (0.3561 => 0.3828, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3516 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3694 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3828 => 0.4097, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.00% (0.3927 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.87% (0.3886 => 0.4153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5925 => 0.6135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.25% (0.6030 => 0.6226, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7326 => 0.7554, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5569 => 0.5710, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8172 => 0.8377, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (10.3673 => 10.5808, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.01% (4.2646 => 4.3503, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: 1.93% (0.7835 => 0.7986, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 1.87% (2.0273 => 2.0653, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.84% (0.5860 => 0.5968, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.9449 => 5.0323, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (5.0018 => 5.0815, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.49% (3.8723 => 3.9299, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.48% (0.9765 => 0.9910, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (10.4361 => 10.5842, std. dev.: 0.0244) MultiSource/Applications/Burg/burg: 1.37% (1.1642 => 1.1801, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.33% (1.5415 => 1.5620, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.32% (2.2969 => 2.3273, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 1.27% (0.8921 => 0.9034, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3050 => 1.3213, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.2024 => 2.2296, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.12% (1.2842 => 1.2986, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.00% (8.1363 => 8.2179, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.57% (26.0924 => 26.7627, std. dev.: 0.0265) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.88% (0.8651 => 0.7277, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7864, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.57% (2.9384 => 2.6867, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.53% (1.1194 => 1.0463, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3493, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.39% (6.6874 => 6.3939, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.09% (5.3855 => 5.1654, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.81% (5.3526 => 5.1487, std. dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.09% (2.2022 => 2.1561, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.72% (22.1758 => 21.7949, std. dev.: 0.0344) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 16:15:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 18:15:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120620231540.C048E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1312?compare_to=1309&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1312, Order: 158856, Start Time: 2012-06-20 22:20:28, End Time: 2012-06-20 23:17:08 To: 1309, Order: 158842, Start Time: 2012-06-20 20:56:50, End Time: 2012-06-20 21:53:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (2.0995 => 2.0784, std. dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2784, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.5818 => 0.6178, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.78% (0.5748 => 0.6080, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.71% (0.7061 => 0.7464, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.7710 => 0.8129, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.82% (1.9828 => 2.0784, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.40% (3.9660 => 4.1406, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.37% (0.5265 => 0.5495, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4016 => 0.4185, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2292 => 1.2806, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.15% (1.3693 => 1.4261, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 4.00% (0.3578 => 0.3721, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.85% (0.3868 => 0.4017, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.84% (0.3646 => 0.3786, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.80% (0.9199 => 0.9549, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.80% (0.3601 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.80% (0.3789 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.79% (0.3663 => 0.3802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 3.73% (0.3914 => 0.4060, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.70% (1.3245 => 1.3735, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.62% (0.4003 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.59% (0.3623 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.55% (0.3940 => 0.4080, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.52% (13.8202 => 14.3073, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.40% (0.3650 => 0.3774, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.30% (1.0594 => 1.0944, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.05% (16.6129 => 17.1191, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.2193 => 1.2550, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (3.8646 => 3.9772, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.89% (1.9270 => 1.9827, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.85% (2.1791 => 2.2411, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5577 => 0.5734, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.4563 => 1.4971, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3755 => 0.3859, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.57% (1.1061 => 1.1345, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.56% (1.3819 => 1.4173, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.53% (0.7506 => 0.7696, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (13.2842 => 13.6154, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.42% (1.3813 => 1.4147, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.8698 => 0.8859, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.76% (7.2180 => 7.3452, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (3.6692 => 3.7291, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.47% (4.3801 => 4.4443, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (4.4433 => 4.5074, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0637, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6499, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.00% (3.1889 => 3.2209, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2727, std. dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1905, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9996 => 1.0793, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7292, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7275, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.77% (1.9144 => 1.9865, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5188, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.05% (7.9275 => 8.1695, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5849, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7155, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0070) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.88% (22.5627 => 20.7844, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.98% (0.3511 => 0.3266, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.8818 => 0.8498, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.6576 => 0.6369, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.06% (0.9108 => 0.8920, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5818, std. dev.: 0.0142) MultiSource/Applications/minisat/minisat: -2.40% (9.3358 => 9.1117, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9584, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9547, std. dev.: 0.0587) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6980, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5122, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2542, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0176) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2360, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 16:44:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 18:44:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120620234414.D58E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1313?compare_to=1311&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1313, Order: 158861, Start Time: 2012-06-20 22:45:04, End Time: 2012-06-20 23:45:43 To: 1311, Order: 158846, Start Time: 2012-06-20 21:17:11, End Time: 2012-06-20 22:18:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (33 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (10.5808 => 10.1679, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3473 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3516 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3497 => 0.3756, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.20% (0.3543 => 0.3798, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3828 => 0.4096, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 6.88% (0.3927 => 0.4197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.77% (0.3886 => 0.4149, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.27% (0.5925 => 0.6119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.22% (0.6030 => 0.6224, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.8172 => 0.8402, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7326 => 0.7512, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5569 => 0.5696, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.93% (0.7835 => 0.7986, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (4.9449 => 5.0319, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.68% (4.2646 => 4.3364, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (10.4361 => 10.5921, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.46% (5.0018 => 5.0746, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.44% (2.0665 => 2.0963, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.44% (2.0273 => 2.0565, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.4186 => 1.4381, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.28% (3.8723 => 3.9217, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 1.15% (1.1642 => 1.1776, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3723, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1861 => 1.1992, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3220, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.01% (1.5415 => 1.5570, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7498, std. dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.26% (0.8651 => 0.7331, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (5.2763 => 4.7911, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.46% (2.9384 => 2.6898, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.72% (1.1194 => 1.0442, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3177, std. dev.: 0.0209) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.36% (6.6874 => 6.3957, std. dev.: 0.0264) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.91% (5.3855 => 5.1751, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.60% (5.3526 => 5.1601, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.05% (2.2022 => 2.1570, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -1.98% (22.1758 => 21.7359, std. dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -1.92% (10.3673 => 10.1679, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 17:39:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 19:39:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621003918.9F80E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1314?compare_to=1312&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1314, Order: 158869, Start Time: 2012-06-20 23:44:03, End Time: 2012-06-21 00:40:46 To: 1312, Order: 158856, Start Time: 2012-06-20 22:20:28, End Time: 2012-06-20 23:17:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.40% (2.0176 => 2.2880, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5818 => 0.6255, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.08% (0.5748 => 0.6155, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.61% (0.7061 => 0.7528, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4328 => 0.4595, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (1.9828 => 2.0937, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.7710 => 0.8135, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3534 => 0.3702, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.72% (3.9660 => 4.1533, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3756 => 0.3927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.53% (0.6959 => 0.7274, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.4390 => 0.4574, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.00% (0.3578 => 0.3721, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 3.98% (0.3646 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.96% (0.3789 => 0.3939, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.95% (0.9199 => 0.9562, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.90% (0.3663 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.86% (0.3601 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.82% (0.4003 => 0.4156, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 3.81% (0.3914 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.65% (0.3940 => 0.4084, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.64% (0.3623 => 0.3755, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3246 => 0.3364, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.62% (16.6129 => 17.2150, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.3245 => 1.3724, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.52% (13.8202 => 14.3069, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 3.51% (0.7038 => 0.7285, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.37% (0.3650 => 0.3773, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (3.8646 => 3.9931, std. dev.: 0.0090) MultiSource/Applications/siod/siod: 3.14% (2.1791 => 2.2476, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2574, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.4563 => 1.5018, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.03% (1.9270 => 1.9854, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.00% (0.7506 => 0.7731, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.90% (1.1061 => 1.1382, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.71% (0.7460 => 0.7662, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.66% (13.2842 => 13.6375, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8698 => 0.8898, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.18% (1.3813 => 1.4114, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (7.2180 => 7.3676, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7391, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.68% (14.8535 => 15.1027, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1515, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (4.3801 => 4.4487, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.4433 => 4.5107, std. dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (6.5754 => 6.6692, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 1.17% (3.1889 => 3.2261, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.5298 => 14.6964, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3985, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.75% (7.4271 => 7.7059, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9190, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5160, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.77% (4.5928 => 4.7200, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1294, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2308 => 1.2463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.74% (22.5627 => 20.8172, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5869, std. dev.: 0.0193) MultiSource/Applications/minisat/minisat: -2.53% (9.3358 => 9.0999, std. dev.: 0.0400) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6986, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9647, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2324, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 17:52:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 19:52:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621005229.CCD4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1315?compare_to=1310&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1315, Order: 158860, Start Time: 2012-06-20 22:38:30, End Time: 2012-06-21 00:53:58 To: 1310, Order: 158837, Start Time: 2012-06-20 19:56:23, End Time: 2012-06-20 22:11:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (39 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.95% (2.0350 => 2.0950, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.10% (0.3446 => 0.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.02% (0.3465 => 0.3743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3460 => 0.3736, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.96% (0.3442 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.92% (0.3496 => 0.3773, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.90% (0.3469 => 0.3743, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.64% (0.3650 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.63% (0.3643 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3488 => 0.3751, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.41% (0.3724 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5826 => 0.6023, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.21% (0.5889 => 0.6078, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (0.5026 => 0.5187, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (1.6211 => 1.6700, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 2.90% (0.7171 => 0.7379, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (3.5627 => 3.6634, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 2.71% (0.9909 => 1.0178, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (2.0673 => 2.1233, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.69% (0.5900 => 0.6059, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.56% (1.3152 => 1.3489, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.51% (0.4029 => 0.4130, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.46% (4.2109 => 4.3146, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (0.4994 => 0.5102, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.12% (0.5000 => 0.5106, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (4.4195 => 4.5112, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 2.07% (1.0781 => 1.1004, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.78% (1.9694 => 2.0045, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (1.9966 => 2.0319, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.76% (2.7292 => 2.7773, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.73% (4.6177 => 4.6974, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.71% (23.5202 => 23.9235, std. dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (2.1653 => 2.2016, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.63% (5.5417 => 5.6321, std. dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (0.6435 => 0.6537, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.42% (1.5932 => 1.6159, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (2.1013 => 2.1305, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.37% (1.8794 => 1.9051, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.27% (1.4269 => 1.4450, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.13% (0.9697 => 0.9807, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.19% (11.9555 => 11.6935, std. dev.: 0.0079) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 18:12:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 20:12:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621011207.8447B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1316?compare_to=1313&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1316, Order: 158875, Start Time: 2012-06-21 00:12:50, End Time: 2012-06-21 01:13:35 To: 1313, Order: 158861, Start Time: 2012-06-20 22:45:04, End Time: 2012-06-20 23:45:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (36 on baseline) Performance Improvements: 3 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 867 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (10.1679 => 10.3281, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (10.5921 => 10.7096, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.16% (3.7831 => 3.8268, std. dev.: 0.0147) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -1.61% (0.7331 => 0.7213, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.09% (5.1751 => 5.1189, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1276 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3543 => 0.3813, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3473 => 0.3736, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.39% (0.3516 => 0.3776, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.38% (0.3497 => 0.3755, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 7.30% (0.3561 => 0.3821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.28% (0.3543 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.98% (0.3694 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3828 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.77% (0.3886 => 0.4149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.3927 => 0.4191, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.05% (0.5925 => 0.6165, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.95% (0.6030 => 0.6268, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.26% (0.8172 => 0.8438, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7326 => 0.7554, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (10.4361 => 10.7096, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (4.2646 => 4.3411, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.76% (0.5860 => 0.5963, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.72% (0.7835 => 0.7970, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0665 => 2.1005, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.5415 => 1.5664, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.52% (1.2842 => 1.3037, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.43% (1.1642 => 1.1809, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.42% (2.0273 => 2.0560, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.9449 => 5.0139, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.34% (0.8067 => 0.8175, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.29% (1.4186 => 1.4369, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.26% (0.9765 => 0.9888, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (5.0018 => 5.0630, std. dev.: 0.0110) MultiSource/Applications/lua/lua: 1.19% (3.8723 => 3.9185, std. dev.: 0.0068) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3734, std. dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.14% (1.1861 => 1.1996, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.07% (2.2969 => 2.3215, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (8.1363 => 8.2182, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7919, std. dev.: 0.0506) MultiSource/Benchmarks/llubenchmark/llu: 1.29% (3.7781 => 3.8268, std. dev.: 0.0147) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.62% (0.8651 => 0.7213, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.55% (5.2763 => 4.7724, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (2.9384 => 2.6901, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.75% (1.1194 => 1.0438, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.38% (54.1659 => 51.2522, std. dev.: 0.0425) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (5.3855 => 5.1189, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.41% (5.3526 => 5.1168, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.19% (6.6874 => 6.4074, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.11% (2.2022 => 2.1557, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -1.79% (22.1758 => 21.7795, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 19:02:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 21:02:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621020244.D362E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1317?compare_to=1314&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1317, Order: 158882, Start Time: 2012-06-21 01:07:34, End Time: 2012-06-21 02:04:12 To: 1314, Order: 158869, Start Time: 2012-06-20 23:44:03, End Time: 2012-06-21 00:40:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (115 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.24% (1.3985 => 1.4158, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -2.03% (0.6255 => 0.6128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.92% (0.6155 => 0.6037, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7528 => 0.7405, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.13% (2.0937 => 2.0700, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2740, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 5.33% (0.5818 => 0.6128, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4328 => 0.4554, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5748 => 0.6037, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7710 => 0.8092, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7061 => 0.7405, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.64% (0.2781 => 0.2910, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.60% (0.2761 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (3.9660 => 4.1472, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.57% (0.3022 => 0.3160, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 4.54% (1.3693 => 1.4314, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.48% (0.6959 => 0.7271, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.45% (0.2966 => 0.3098, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.45% (0.2607 => 0.2723, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2782 => 0.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.41% (0.5265 => 0.5497, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.40% (1.9828 => 2.0700, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.2726 => 0.2845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3899 => 0.4067, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2760 => 0.2878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.27% (0.2765 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3107 => 0.3232, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.02% (1.2292 => 1.2786, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.3245 => 1.3771, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9199 => 0.9563, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3192 => 0.3316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.2988 => 0.3097, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.0594 => 1.0967, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.49% (13.8202 => 14.3030, std. dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7038 => 0.7277, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3534 => 0.3652, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.32% (16.6129 => 17.1647, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.30% (0.5637 => 0.5823, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.28% (0.3868 => 0.3995, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8646 => 3.9882, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.18% (2.1791 => 2.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.2193 => 1.2571, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.09% (1.9270 => 1.9865, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.4563 => 1.5003, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 2.97% (0.4003 => 0.4122, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 2.82% (0.3578 => 0.3679, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.77% (1.1061 => 1.1367, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 2.76% (0.3914 => 0.4022, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.66% (0.7506 => 0.7706, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 2.59% (0.3940 => 0.4042, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6131, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7460 => 0.7642, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.3819 => 1.4093, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (7.2180 => 7.3566, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (3.6692 => 3.7346, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1333 => 1.1517, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.62% (14.8535 => 15.0936, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.3801 => 4.4485, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.48% (4.4433 => 4.5089, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.5754 => 6.6651, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2267, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6918, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2700, std. dev.: 0.0459) SingleSource/Benchmarks/Misc/mandel-2: 8.92% (1.2998 => 1.4158, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7259, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1513, std. dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7136, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9559, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std. dev.: 0.0235) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.5627 => 20.8607, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.82% (0.6576 => 0.6325, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5890, std. dev.: 0.0122) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1001, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6981, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9902, std. dev.: 0.0430) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2351, std. dev.: 0.0212) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 19:39:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 21:39:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621023945.B8D502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1318?compare_to=1316&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1318, Order: 158884, Start Time: 2012-06-21 01:40:30, End Time: 2012-06-21 02:41:12 To: 1316, Order: 158875, Start Time: 2012-06-21 00:12:50, End Time: 2012-06-21 01:13:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (19 on baseline) Performance Improvements: 7 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 865 (839 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (5.1189 => 5.1991, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (10.3281 => 10.1016, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: -1.95% (10.7096 => 10.5003, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference-object: -1.63% (0.6268 => 0.6166, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.62% (0.6165 => 0.6065, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.50% (21.7795 => 21.4519, std. dev.: 0.0175) SingleSource/UnitTests/ObjC++/property-reference: -1.46% (0.7554 => 0.7444, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.82% (3.8268 => 3.7572, std. dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.28% (0.3473 => 0.3691, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.04% (0.3543 => 0.3757, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3497 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3543 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3561 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.77% (0.3694 => 0.3907, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.3927 => 0.4149, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 5.56% (0.3828 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.8172 => 0.8451, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 2.36% (0.5925 => 0.6065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.26% (0.6030 => 0.6166, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.7326 => 0.7444, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.38% (0.7835 => 0.7943, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.14% (4.2646 => 4.3134, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 1.08% (2.0273 => 2.0491, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.45% (26.0924 => 26.7318, std. dev.: 0.0380) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.74% (0.8651 => 0.7289, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.55% (5.2763 => 4.7726, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.81% (2.9384 => 2.6794, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.02% (1.1194 => 1.0408, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4409, std. dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.48% (6.6874 => 6.3881, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.58% (5.3526 => 5.1612, std. dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.46% (5.3855 => 5.1991, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: -3.26% (22.1758 => 21.4519, std. dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.58% (2.2022 => 2.1454, std. dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -2.56% (10.3673 => 10.1016, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.15% (0.4879 => 0.4774, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.55% (7.0540 => 6.9447, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.03% (1.7609 => 1.7427, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 20:26:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 22:26:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621032625.F18CA2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/1319?compare_to=1317&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1319, Order: 158889, Start Time: 2012-06-21 02:31:03, End Time: 2012-06-21 03:27:53 To: 1317, Order: 158882, Start Time: 2012-06-21 01:07:34, End Time: 2012-06-21 02:04:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.16% (2.0176 => 2.2831, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5818 => 0.6163, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5748 => 0.6061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.10% (0.7061 => 0.7421, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4328 => 0.4548, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.7710 => 0.8084, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.54% (3.9660 => 4.1462, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4062 => 0.4246, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.6959 => 0.7261, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.33% (0.3899 => 0.4068, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.29% (1.3693 => 1.4280, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.14% (0.2607 => 0.2715, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2765 => 0.2877, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2655 => 0.2762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2761 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.9828 => 2.0617, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.3245 => 1.3771, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9199 => 0.9556, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.85% (0.3580 => 0.3718, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.64% (13.8202 => 14.3234, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3489 => 0.3616, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.60% (0.3246 => 0.3363, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3485 => 0.3608, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3293 => 0.3408, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.45% (16.6129 => 17.1865, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.41% (0.2988 => 0.3090, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.7038 => 0.7272, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4390 => 0.4533, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.25% (2.1791 => 2.2499, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (3.8646 => 3.9899, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.2193 => 1.2587, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3868 => 0.3990, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.4563 => 1.5021, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1718, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.11% (0.3789 => 0.3907, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.08% (1.9270 => 1.9863, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 3.04% (0.3914 => 0.4033, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.00% (0.3601 => 0.3709, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 2.99% (0.3646 => 0.3755, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.91% (1.1061 => 1.1383, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.88% (0.3650 => 0.3755, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 2.87% (0.3623 => 0.3727, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (13.2842 => 13.6570, std. dev.: 0.0197) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (0.7460 => 0.7653, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (1.3813 => 1.4125, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (7.2180 => 7.3669, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (3.6692 => 3.7418, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.86% (4.3801 => 4.4614, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 1.82% (14.8535 => 15.1237, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.1333 => 1.1536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.8698 => 0.8845, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5168, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (6.5754 => 6.6777, std. dev.: 0.0095) MultiSource/Applications/d/make_dparser: 1.45% (3.1889 => 3.2352, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.34% (14.5298 => 14.7250, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2749 => 1.2915, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4481, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3085, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.79% (0.4846 => 0.6968, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0519) SingleSource/Benchmarks/Misc/mandel-2: 8.79% (1.2998 => 1.4141, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1905, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7291, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5157, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.88% (7.9275 => 8.1562, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5839, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7131, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (0.5184 => 0.5301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.42% (22.5627 => 20.8878, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0152) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6017, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1071, std. dev.: 0.0345) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9579, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4992, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9527, std. dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7015, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2475, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4882, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2308, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 20:34:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 22:34:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621033436.047132A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/1320?compare_to=1315&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1320, Order: 158884, Start Time: 2012-06-21 01:20:41, End Time: 2012-06-21 03:36:02 To: 1315, Order: 158860, Start Time: 2012-06-20 22:38:30, End Time: 2012-06-21 00:53:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (28 on baseline) Performance Improvements: 8 (2 on baseline) Unchanged Tests: 886 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (2.4559 => 2.3827, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.21% (4.5112 => 4.4564, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -1.21% (4.6974 => 4.6404, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (2.7773 => 2.7444, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.03% (2.1305 => 2.1085, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.03% (2.2016 => 2.1790, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -1.01% (2.0529 => 2.0321, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.00% (2.0319 => 2.0115, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.29% (0.3792 => 0.4258, std. dev.: 0.0132) SingleSource/UnitTests/ObjC/exceptions-4: 6.84% (0.3465 => 0.3702, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3488 => 0.3726, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.82% (0.3446 => 0.3681, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3460 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3442 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.72% (0.3469 => 0.3702, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.64% (0.3496 => 0.3728, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3643 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.36% (0.3650 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.15% (0.3724 => 0.3953, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (0.5026 => 0.5174, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 2.88% (0.5826 => 0.5994, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.71% (0.5900 => 0.6060, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.68% (0.5889 => 0.6047, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.37% (0.7171 => 0.7341, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (1.6211 => 1.6578, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0673 => 2.1077, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.89% (4.2109 => 4.2904, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (1.3152 => 1.3399, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.84% (3.5627 => 3.6284, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.75% (0.9909 => 1.0082, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.59% (1.5932 => 1.6185, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.37% (23.5202 => 23.8435, std. dev.: 0.0119) MultiSource/Applications/d/make_dparser: 1.34% (1.0781 => 1.0926, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.07% (0.9697 => 0.9801, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (1.9694 => 1.9903, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.78% (2.4764 => 2.3827, std. dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: -2.56% (11.9555 => 11.6498, std. dev.: 0.0046) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 21:07:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 23:07:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621040731.E7F7E2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1321?compare_to=1318&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1321, Order: 158894, Start Time: 2012-06-21 03:08:18, End Time: 2012-06-21 04:08:59 To: 1318, Order: 158884, Start Time: 2012-06-21 01:40:30, End Time: 2012-06-21 02:41:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (21 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (837 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3543 => 0.3779, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.25% (0.3473 => 0.3690, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3497 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.03% (0.3516 => 0.3728, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3561 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3543 => 0.3755, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.77% (0.3694 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.3927 => 0.4149, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.56% (0.3886 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.54% (0.3828 => 0.4040, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.23% (0.3121 => 0.3253, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.70% (0.5925 => 0.6085, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.59% (0.6030 => 0.6186, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.90% (0.7326 => 0.7465, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (2.0665 => 2.0966, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.43% (0.7835 => 0.7947, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.36% (2.0273 => 2.0549, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.24% (4.2646 => 4.3174, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2842 => 1.2996, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.11% (2.2969 => 2.3224, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7540, std. dev.: 0.0344) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.76% (0.8651 => 0.7288, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.66% (5.2763 => 4.7666, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.68% (2.9384 => 2.6834, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (1.1194 => 1.0418, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -4.77% (54.1659 => 51.5829, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.41% (6.6874 => 6.3928, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.57% (5.3526 => 5.1614, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.42% (5.3855 => 5.2014, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -3.35% (10.3673 => 10.0202, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: -3.23% (22.1758 => 21.4602, std. dev.: 0.0281) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.78% (2.2022 => 2.1410, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.48% (0.4879 => 0.4758, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.62% (1.7609 => 1.7323, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.55% (7.0540 => 6.9446, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 21:50:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 20 Jun 2012 23:50:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621045031.932502A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1322?compare_to=1319&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1322, Order: 158895, Start Time: 2012-06-21 03:54:42, End Time: 2012-06-21 04:51:59 To: 1319, Order: 158889, Start Time: 2012-06-21 02:31:03, End Time: 2012-06-21 03:27:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.29% (1.4141 => 1.3959, std. dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2823, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.10% (0.7061 => 0.7492, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 5.55% (0.5818 => 0.6141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.31% (0.5748 => 0.6053, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3899 => 0.4082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5265 => 0.5506, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 4.56% (1.3693 => 1.4318, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.51% (1.9828 => 2.0723, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.45% (0.2765 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (3.9660 => 4.1402, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3580 => 0.3736, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.33% (0.6959 => 0.7260, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.22% (1.2292 => 1.2811, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.04% (0.3489 => 0.3630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3453 => 0.3592, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.9199 => 0.9550, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.51% (13.8202 => 14.3048, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 3.48% (16.6129 => 17.1904, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.7038 => 0.7280, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.36% (0.3868 => 0.3998, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0594 => 1.0939, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8646 => 3.9881, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5637 => 0.5817, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.11% (2.1791 => 2.2468, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5014, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.94% (1.9270 => 1.9837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.2193 => 1.2550, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.77% (1.1061 => 1.1367, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (0.7460 => 0.7649, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (13.2842 => 13.6175, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.3819 => 1.4115, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.91% (7.2180 => 7.3557, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.8698 => 0.8852, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.6135 => 0.6243, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.72% (3.6692 => 3.7323, std. dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0877, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.3801 => 4.4464, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1333 => 1.1504, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.4433 => 4.5088, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.39% (6.5754 => 6.6670, std. dev.: 0.0143) MultiSource/Applications/d/make_dparser: 1.27% (3.1889 => 3.2293, std. dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std. dev.: 0.0547) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.17% (2.0200 => 2.1851, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3959, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7393, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.82% (7.9275 => 8.1512, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7144, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.83% (0.4657 => 0.4106, std. dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.5627 => 20.8622, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -2.70% (9.3358 => 9.0838, std. dev.: 0.0393) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0267) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9580, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9300, std. dev.: 0.0417) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6978, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2215, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.01% (3.9173 => 3.8777, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 22:35:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 00:35:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621053501.DEF342A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1323?compare_to=1321&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1323, Order: 158895, Start Time: 2012-06-21 04:35:51, End Time: 2012-06-21 05:36:30 To: 1321, Order: 158894, Start Time: 2012-06-21 03:08:18, End Time: 2012-06-21 04:08:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.15% (10.0202 => 10.3356, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.65% (3.8611 => 3.7587, std. dev.: 0.0289) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3473 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3516 => 0.3714, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.53% (0.3543 => 0.3739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.52% (0.3497 => 0.3690, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.48% (0.3561 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.48% (0.3543 => 0.3737, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 5.40% (0.3927 => 0.4139, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.22% (0.3694 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.22% (0.3828 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.10% (0.3886 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.19% (0.5925 => 0.6114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.99% (0.6030 => 0.6210, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.73% (0.7326 => 0.7526, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.73% (0.8172 => 0.8395, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.2646 => 4.3268, std. dev.: 0.0071) MultiSource/Applications/treecc/treecc: 1.42% (2.0273 => 2.0561, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.34% (2.2969 => 2.3277, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.5415 => 1.5606, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (2.0665 => 2.0913, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 1.14% (1.2842 => 1.2989, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.14% (1.1642 => 1.1775, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.12% (3.8723 => 3.9155, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2263, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.03% (0.9765 => 0.9866, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.0018 => 5.0528, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.4186 => 1.4330, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.00% (1.1861 => 1.1980, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (4.9449 => 4.9944, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7528, std. dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.72% (0.8651 => 0.7291, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.53% (5.2763 => 4.7737, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.76% (2.9384 => 2.6811, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (1.1194 => 1.0418, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4940, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.41% (6.6874 => 6.3922, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.42% (5.3526 => 5.1697, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.31% (5.3855 => 5.2074, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -3.00% (22.1758 => 21.5110, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.65% (2.2022 => 2.1439, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.07% (0.4879 => 0.4778, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.40% (7.0540 => 6.9551, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 23:16:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 01:16:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621061642.CEAAE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1324?compare_to=1320&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1324, Order: 158895, Start Time: 2012-06-21 04:02:45, End Time: 2012-06-21 06:18:10 To: 1320, Order: 158884, Start Time: 2012-06-21 01:20:41, End Time: 2012-06-21 03:36:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (2.0462 => 2.0912, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.39% (0.3488 => 0.3711, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 6.36% (0.3460 => 0.3680, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 6.36% (0.3446 => 0.3665, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.35% (0.3465 => 0.3685, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.26% (0.3469 => 0.3686, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3442 => 0.3655, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.18% (0.3496 => 0.3712, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.07% (0.3643 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.97% (0.3650 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.85% (0.3724 => 0.3942, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (0.5026 => 0.5200, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 3.42% (0.5826 => 0.6025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.84% (0.7171 => 0.7375, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.5900 => 0.6058, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (1.6211 => 1.6623, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (3.5627 => 3.6439, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (1.3152 => 1.3442, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (0.4994 => 0.5102, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.10% (4.2109 => 4.2993, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.09% (2.0673 => 2.1105, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 1.96% (0.9909 => 1.0103, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.63% (1.0781 => 1.0957, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.38% (23.5202 => 23.8455, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (1.9694 => 1.9944, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (4.4195 => 4.4744, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 1.22% (1.8794 => 1.9024, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.17% (5.5417 => 5.6067, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (1.9966 => 2.0198, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.09% (1.5932 => 1.6106, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (2.1653 => 2.1872, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.05% (2.4764 => 2.3760, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -2.51% (11.9555 => 11.6555, std. dev.: 0.0064) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 20 23:46:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 01:46:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621064607.E78282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1325?compare_to=1322&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1325, Order: 158896, Start Time: 2012-06-21 05:50:52, End Time: 2012-06-21 06:47:35 To: 1322, Order: 158895, Start Time: 2012-06-21 03:54:42, End Time: 2012-06-21 04:51:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.21% (7.9526 => 8.0488, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.11% (2.0176 => 2.2821, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.59% (0.5818 => 0.6143, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4328 => 0.4562, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5748 => 0.6054, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7061 => 0.7412, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 4.90% (0.4062 => 0.4261, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.7710 => 0.8070, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2765 => 0.2889, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.48% (1.3693 => 1.4306, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.42% (1.9828 => 2.0704, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.37% (3.9660 => 4.1394, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.6959 => 0.7255, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.25% (0.3580 => 0.3732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5265 => 0.5484, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.15% (1.2292 => 1.2802, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3192 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9199 => 0.9552, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4390 => 0.4548, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3534 => 0.3656, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.39% (13.8202 => 14.2888, std. dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 3.39% (16.6129 => 17.1760, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 3.39% (0.3868 => 0.3999, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.7038 => 0.7269, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.4563 => 1.5020, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.5637 => 0.5812, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (3.8646 => 3.9845, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2439, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5577 => 0.5734, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.79% (1.9270 => 1.9807, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 2.75% (1.1061 => 1.1365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6194, std. dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.7460 => 0.7646, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.48% (0.7506 => 0.7692, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.07% (1.3813 => 1.4099, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (7.2180 => 7.3526, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6135 => 0.6246, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.8698 => 0.8852, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.72% (3.6692 => 3.7322, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0897, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.3801 => 4.4438, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.33% (4.4433 => 4.5026, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.5754 => 6.6599, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 1.05% (16.2614 => 16.4316, std. dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/fbench: 25.20% (1.8175 => 2.2756, std. dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7347, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5169, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.88% (7.9275 => 8.1560, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5839, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7139, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.2308 => 1.2438, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.18% (0.4657 => 0.3857, std. dev.: 0.0234) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.50% (22.5627 => 20.8708, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.86% (0.6576 => 0.6388, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.63% (9.3358 => 9.0906, std. dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6024, std. dev.: 0.0126) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6985, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9892, std. dev.: 0.0455) SingleSource/Benchmarks/Shootout/heapsort: -1.71% (3.9173 => 3.8503, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.62% (0.8342 => 0.8207, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 00:03:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 02:03:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621070355.1B5BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1326?compare_to=1323&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1326, Order: 158897, Start Time: 2012-06-21 06:03:30, End Time: 2012-06-21 07:05:21 To: 1323, Order: 158895, Start Time: 2012-06-21 04:35:51, End Time: 2012-06-21 05:36:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (26 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7587 => 3.8345, std. dev.: 0.0158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.64% (0.3473 => 0.3669, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.58% (0.3497 => 0.3692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.50% (0.3561 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.48% (0.3543 => 0.3737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.43% (0.3516 => 0.3707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.42% (0.3543 => 0.3735, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 5.25% (0.3694 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.25% (0.3927 => 0.4133, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 5.22% (0.3886 => 0.4089, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 5.07% (0.3828 => 0.4022, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.8172 => 0.8443, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 3.11% (0.5925 => 0.6109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.03% (0.6030 => 0.6213, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 2.68% (0.7326 => 0.7522, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.47% (4.2646 => 4.3271, std. dev.: 0.0069) MultiSource/Applications/treecc/treecc: 1.44% (2.0273 => 2.0565, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.16% (3.8723 => 3.9171, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5590, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.2842 => 1.2987, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.10% (1.1642 => 1.1770, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1861 => 1.1986, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4333, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.04% (4.9449 => 4.9961, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.2024 => 2.2252, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.72% (26.0924 => 26.8031, std. dev.: 0.0121) MultiSource/Benchmarks/llubenchmark/llu: 1.49% (3.7781 => 3.8345, std. dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.65% (0.8651 => 0.7297, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.56% (5.2763 => 4.7717, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.81% (2.9384 => 2.6795, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (1.1194 => 1.0412, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5118, std. dev.: 0.0458) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.46% (6.6874 => 6.3892, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.47% (5.3526 => 5.1669, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.17% (5.3855 => 5.2146, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -3.13% (22.1758 => 21.4825, std. dev.: 0.0329) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (2.2022 => 2.1444, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.32% (7.0540 => 6.9608, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7412, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 01:14:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 03:14:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621081419.29AD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1327?compare_to=1325&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1327, Order: 158902, Start Time: 2012-06-21 07:18:54, End Time: 2012-06-21 08:15:45 To: 1325, Order: 158896, Start Time: 2012-06-21 05:50:52, End Time: 2012-06-21 06:47:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.61% (2.0176 => 2.2721, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4328 => 0.4556, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.17% (0.5818 => 0.6119, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.96% (0.2781 => 0.2919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.85% (0.5748 => 0.6027, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.76% (0.2690 => 0.2818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.72% (0.7061 => 0.7394, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.59% (1.3693 => 1.4322, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.48% (0.2966 => 0.3099, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2760 => 0.2883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.38% (0.2765 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (1.9828 => 2.0695, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3899 => 0.4067, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.7710 => 0.8038, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.23% (3.9660 => 4.1336, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3489 => 0.3634, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.5265 => 0.5478, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2292 => 1.2785, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.99% (0.6959 => 0.7237, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.98% (0.3293 => 0.3424, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9199 => 0.9529, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.44% (0.3868 => 0.4001, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7038 => 0.7277, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.3534 => 0.3654, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.3245 => 1.3682, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.29% (16.6129 => 17.1602, std. dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 3.19% (13.8202 => 14.2616, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9813, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2399, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2523, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.69% (0.5577 => 0.5727, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.4563 => 1.4950, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.60% (1.9270 => 1.9771, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.48% (1.1061 => 1.1335, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5950, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: 2.25% (0.7506 => 0.7675, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (1.3819 => 1.4109, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6135 => 0.6240, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (3.6692 => 3.7250, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (7.2180 => 7.3258, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.3801 => 4.4379, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0474, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.30% (1.1333 => 1.1480, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (4.4433 => 4.4976, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (6.5754 => 6.6440, std. dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2674, std. dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0166) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.91% (7.9275 => 8.1582, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.68% (4.5928 => 4.7161, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.5184 => 0.5310, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8417, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.14% (33.2944 => 32.9152, std. dev.: 0.0226) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1168, std. dev.: 0.0232) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9583, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9435, std. dev.: 0.0320) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6998, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2469, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2358, std. dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 01:34:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 03:34:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621083433.EFBE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1328?compare_to=1326&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1328, Order: 158903, Start Time: 2012-06-21 07:35:13, End Time: 2012-06-21 08:36:01 To: 1326, Order: 158897, Start Time: 2012-06-21 06:03:30, End Time: 2012-06-21 07:05:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (17 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (842 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (10.3378 => 10.4973, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.33% (0.7522 => 0.7422, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 4.88% (0.3543 => 0.3716, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.41% (0.3473 => 0.3626, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.23% (0.3543 => 0.3693, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.23% (0.3497 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.21% (0.3561 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.18% (0.3516 => 0.3663, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.09% (0.3694 => 0.3845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.97% (0.3927 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.94% (0.3828 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.89% (0.3886 => 0.4037, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 1.94% (0.5925 => 0.6040, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (10.3673 => 10.4973, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.2646 => 4.3155, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.14% (1.2842 => 1.2988, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.07% (2.0273 => 2.0490, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 1.02% (3.8723 => 3.9117, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7411, std. dev.: 0.0288) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.38% (0.8651 => 0.7234, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.68% (5.2763 => 4.7657, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.12% (2.9384 => 2.6704, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (1.1194 => 1.0411, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.40% (54.1659 => 51.2385, std. dev.: 0.0455) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.36% (6.6874 => 6.3955, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.74% (5.3526 => 5.1522, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.47% (5.3855 => 5.1988, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -3.22% (22.1758 => 21.4623, std. dev.: 0.0518) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.57% (2.2022 => 2.1457, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.40% (0.4879 => 0.4762, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.30% (1.7609 => 1.7380, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.25% (7.0540 => 6.9657, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 02:03:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 04:03:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621090309.744CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1329?compare_to=1324&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1329, Order: 158902, Start Time: 2012-06-21 06:46:55, End Time: 2012-06-21 09:04:34 To: 1324, Order: 158895, Start Time: 2012-06-21 04:02:45, End Time: 2012-06-21 06:18:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 5.88% (0.3488 => 0.3693, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 5.86% (0.3465 => 0.3668, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.80% (0.3446 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3460 => 0.3657, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.68% (0.3469 => 0.3666, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.67% (0.3442 => 0.3637, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.64% (0.3496 => 0.3693, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.40% (0.3650 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.38% (0.3643 => 0.3839, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.18% (0.3724 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.97% (0.5826 => 0.5999, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.86% (0.7171 => 0.7376, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.5889 => 0.6055, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (0.5026 => 0.5160, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (0.4994 => 0.5127, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (1.6211 => 1.6619, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.5900 => 0.6036, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.27% (1.3152 => 1.3451, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (0.5000 => 0.5112, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.08% (0.9909 => 1.0115, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (3.5627 => 3.6364, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (2.0673 => 2.1097, std. dev.: 0.0117) MultiSource/Applications/oggenc/oggenc: 1.98% (1.5932 => 1.6247, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 1.83% (4.2109 => 4.2880, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (1.9694 => 1.9936, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.12% (4.4195 => 4.4689, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.89% (2.4764 => 2.3552, std. dev.: 0.0361) MultiSource/Applications/kimwitu++/kc: -2.60% (11.9555 => 11.6449, std. dev.: 0.0145) Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 02:38:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 04:38:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621093809.CC7A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1330?compare_to=1327&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1330, Order: 158904, Start Time: 2012-06-21 08:42:44, End Time: 2012-06-21 09:39:37 To: 1327, Order: 158902, Start Time: 2012-06-21 07:18:54, End Time: 2012-06-21 08:15:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.61% (2.0176 => 2.2720, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0081) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.14% (0.5818 => 0.6117, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 4.89% (0.5748 => 0.6029, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.87% (0.2607 => 0.2734, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.4062 => 0.4258, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.77% (0.7061 => 0.7398, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2655 => 0.2780, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.54% (1.3693 => 1.4315, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2760 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.47% (1.9828 => 2.0715, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.20% (3.9660 => 4.1324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.5265 => 0.5476, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 4.00% (1.2292 => 1.2784, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3453 => 0.3590, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 3.33% (16.6129 => 17.1660, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.7038 => 0.7272, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2664, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5637 => 0.5808, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (3.8646 => 3.9789, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2430, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.4563 => 1.4981, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.79% (1.2193 => 1.2533, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.71% (1.9270 => 1.9792, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.64% (0.5577 => 0.5724, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 2.57% (1.1061 => 1.1345, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5835, std. dev.: 0.0123) MultiSource/Applications/spiff/spiff: 2.24% (0.7506 => 0.7674, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4113, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.8698 => 0.8859, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7274, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.53% (14.8535 => 15.0809, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (7.2180 => 7.3252, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.3801 => 4.4407, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (4.4433 => 4.4978, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (6.5754 => 6.6437, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.28% (1.8175 => 2.2769, std. dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7327, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5848, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.70% (7.9275 => 8.1415, std. dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 2.58% (4.5928 => 4.7114, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.41% (1.9433 => 1.9707, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2460, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.07% (1.9290 => 1.9497, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.64% (22.5627 => 20.8396, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.11% (33.2944 => 32.9262, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3184, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.53% (9.3358 => 9.0996, std. dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6079, std. dev.: 0.0193) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9589, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9087, std. dev.: 0.0368) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6984, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2287, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 03:02:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 05:02:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621100205.8A5202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1331?compare_to=1328&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1331, Order: 158906, Start Time: 2012-06-21 09:03:00, End Time: 2012-06-21 10:03:34 To: 1328, Order: 158903, Start Time: 2012-06-21 07:35:13, End Time: 2012-06-21 08:36:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (19 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (840 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.30% (0.3473 => 0.3657, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.18% (0.3497 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.17% (0.3543 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.11% (0.3561 => 0.3743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.08% (0.3543 => 0.3723, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 5.01% (0.3694 => 0.3879, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 5.01% (0.3516 => 0.3692, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 4.74% (0.3927 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.73% (0.3828 => 0.4009, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 4.61% (0.3886 => 0.4065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.45% (0.6030 => 0.6178, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.8172 => 0.8372, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 2.45% (0.5925 => 0.6070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.38% (0.7326 => 0.7500, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.43% (4.2646 => 4.3254, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 1.29% (0.7835 => 0.7936, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.16% (2.0273 => 2.0509, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0874, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7748, std. dev.: 0.0267) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.31% (0.8651 => 0.7240, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.79% (5.2763 => 4.7595, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.04% (2.9384 => 2.6728, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (1.1194 => 1.0404, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3151, std. dev.: 0.0575) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.51% (6.6874 => 6.3855, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.66% (5.3526 => 5.1566, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.56% (5.3855 => 5.1940, std. dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: -3.04% (22.1758 => 21.5026, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (2.2022 => 2.1446, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.40% (0.4879 => 0.4762, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.33% (7.0540 => 6.9600, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.24% (1.7609 => 1.7391, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 04:02:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 06:02:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621110206.938502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1332?compare_to=1330&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1332, Order: 158908, Start Time: 2012-06-21 10:06:43, End Time: 2012-06-21 11:03:35 To: 1330, Order: 158904, Start Time: 2012-06-21 08:42:44, End Time: 2012-06-21 09:39:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.17% (2.0176 => 2.2834, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.5818 => 0.6171, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 5.79% (0.5748 => 0.6081, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.25% (0.7061 => 0.7432, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.7710 => 0.8094, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.80% (1.9828 => 2.0779, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3192 => 0.3345, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (3.9660 => 4.1423, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.17% (0.6959 => 0.7249, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.83% (0.4390 => 0.4558, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.55% (1.3245 => 1.3715, std. dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 3.47% (16.6129 => 17.1893, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7038 => 0.7277, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2791, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5637 => 0.5824, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0941, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 3.15% (3.8646 => 3.9862, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2455, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4992, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1677, std. dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.72% (0.7460 => 0.7663, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.72% (1.9270 => 1.9794, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3755 => 0.3855, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.63% (1.1061 => 1.1352, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 2.54% (0.7506 => 0.7697, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.43% (1.3813 => 1.4148, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5990, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.19% (1.3819 => 1.4122, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8698 => 0.8868, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6135 => 0.6247, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.72% (7.2180 => 7.3418, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (3.6692 => 3.7315, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0888, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (4.3801 => 4.4452, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5069, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6544, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2258, std. dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7348, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9189, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5862, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.71% (4.5928 => 4.7173, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1286, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2444, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.5627 => 20.8921, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.6576 => 0.6345, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.59% (9.3358 => 9.0940, std. dev.: 0.0190) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6142, std. dev.: 0.0091) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9577, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.6991, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9674, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2322, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2561, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 04:30:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 06:30:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621113005.B080E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1333?compare_to=1331&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1333, Order: 158910, Start Time: 2012-06-21 10:30:33, End Time: 2012-06-21 11:31:34 To: 1331, Order: 158906, Start Time: 2012-06-21 09:03:00, End Time: 2012-06-21 10:03:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (31 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (831 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.41% (10.4343 => 10.2870, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.41% (0.3473 => 0.3661, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 5.20% (0.3561 => 0.3746, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.17% (0.3543 => 0.3726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.17% (0.3543 => 0.3726, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 5.15% (0.3497 => 0.3677, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.09% (0.3516 => 0.3695, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 4.95% (0.3694 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.89% (0.3927 => 0.4119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.83% (0.3828 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.68% (0.3886 => 0.4068, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.19% (0.8172 => 0.8433, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 2.58% (0.5925 => 0.6078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.42% (0.6030 => 0.6176, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 1.82% (0.7326 => 0.7459, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.65% (0.7835 => 0.7964, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.47% (3.8723 => 3.9294, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0130, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (4.2646 => 4.3229, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.5415 => 1.5607, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (10.4361 => 10.5632, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.2024 => 2.2269, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.10% (1.1642 => 1.1770, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.2842 => 1.2980, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.04% (0.9765 => 0.9867, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.04% (5.0018 => 5.0537, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (2.0665 => 2.0879, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 1.02% (1.1840 => 1.1961, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7821, std. dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.62% (0.8651 => 0.7300, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.46% (5.2763 => 4.7774, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.59% (2.9384 => 2.6860, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0477, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.15% (54.1659 => 51.3756, std. dev.: 0.0521) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.27% (6.6874 => 6.4020, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.21% (5.3855 => 5.2124, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.19% (5.3526 => 5.1820, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: -3.01% (22.1758 => 21.5091, std. dev.: 0.0294) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.33% (2.2022 => 2.1509, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 04:49:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 06:49:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621114902.B39EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1334?compare_to=1329&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1334, Order: 158908, Start Time: 2012-06-21 09:34:55, End Time: 2012-06-21 11:50:31 To: 1329, Order: 158902, Start Time: 2012-06-21 06:46:55, End Time: 2012-06-21 09:04:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (21 on baseline) Performance Improvements: 1 (3 on baseline) Unchanged Tests: 893 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.37% (1.6247 => 1.6025, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 5.48% (0.3465 => 0.3655, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.41% (0.3496 => 0.3685, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.40% (0.3446 => 0.3632, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.36% (0.3488 => 0.3675, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.32% (0.3442 => 0.3625, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.29% (0.3460 => 0.3643, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.25% (0.3469 => 0.3651, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.91% (0.3643 => 0.3822, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.81% (0.3724 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5826 => 0.6026, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.5889 => 0.6076, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7171 => 0.7370, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (0.5026 => 0.5160, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.5900 => 0.6037, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.97% (1.6211 => 1.6530, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (2.0673 => 2.1067, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (3.5627 => 3.6277, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (1.3152 => 1.3368, std. dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 1.62% (0.9909 => 1.0070, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.35% (4.2109 => 4.2676, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.53% (2.8036 => 2.8466, std. dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.28% (2.4764 => 2.3705, std. dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.82% (0.4253 => 0.4133, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -2.72% (11.9555 => 11.6309, std. dev.: 0.0125) Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 05:25:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 07:25:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621122547.F22832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1335?compare_to=1332&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1335, Order: 158912, Start Time: 2012-06-21 11:30:27, End Time: 2012-06-21 12:27:16 To: 1332, Order: 158908, Start Time: 2012-06-21 10:06:43, End Time: 2012-06-21 11:03:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.08% (2.0176 => 2.2816, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5818 => 0.6163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.71% (0.5748 => 0.6076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.24% (0.7061 => 0.7431, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.15% (0.4062 => 0.4271, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7710 => 0.8097, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.93% (1.3693 => 1.4368, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.89% (0.2760 => 0.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.79% (1.9828 => 2.0777, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (3.9660 => 4.1423, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.6959 => 0.7268, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2292 => 1.2819, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.3868 => 0.4022, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.83% (0.4390 => 0.4558, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.76% (0.3246 => 0.3368, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 3.54% (13.8202 => 14.3101, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.47% (1.3245 => 1.3705, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 3.42% (16.6129 => 17.1817, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.0594 => 1.0945, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5637 => 0.5822, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.4563 => 1.5003, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (3.8646 => 3.9802, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2437, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.2193 => 1.2543, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1685, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.75% (1.9270 => 1.9800, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.7460 => 0.7651, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6019, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.19% (1.3819 => 1.4121, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (3.6692 => 3.7389, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (7.2180 => 7.3429, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.3801 => 4.4468, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0762, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1499, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (4.4433 => 4.5055, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2285, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6518, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3074, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.73% (1.2998 => 1.3873, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7148, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (12.4560 => 12.9285, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9776, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5870, std. dev.: 0.0345) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.70% (7.9275 => 8.1415, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7148, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.71% (1.9290 => 1.9619, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9350, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.53% (0.6576 => 0.6344, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5813, std. dev.: 0.0165) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0958, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.30% (3.0263 => 2.9568, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9476, std. dev.: 0.0346) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6971, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2581, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2328, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 05:57:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 07:57:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621125736.9C4732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1336?compare_to=1333&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1336, Order: 158912, Start Time: 2012-06-21 11:58:28, End Time: 2012-06-21 12:59:06 To: 1333, Order: 158910, Start Time: 2012-06-21 10:30:33, End Time: 2012-06-21 11:31:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (28 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.14% (1.2305 => 1.2445, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 5.67% (0.3543 => 0.3744, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 5.41% (0.3473 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.20% (0.3497 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.17% (0.3561 => 0.3745, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 5.14% (0.3543 => 0.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.12% (0.3516 => 0.3696, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.09% (0.3694 => 0.3882, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 4.83% (0.3828 => 0.4013, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 4.81% (0.3927 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.68% (0.3886 => 0.4068, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.8172 => 0.8418, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 2.60% (0.5925 => 0.6079, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.42% (0.6030 => 0.6176, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.21% (0.4615 => 0.4717, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.86% (0.7326 => 0.7462, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.44% (0.7835 => 0.7948, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.39% (4.2646 => 4.3237, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.5415 => 1.5606, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (10.4361 => 10.5645, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (5.0018 => 5.0618, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.17% (3.8723 => 3.9177, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.11% (2.0273 => 2.0498, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1861 => 1.1986, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (4.9449 => 4.9967, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (2.2024 => 2.2251, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.4186 => 1.4329, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.00% (3.3354 => 3.3688, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7440, std. dev.: 0.0328) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.73% (0.8651 => 0.7290, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.48% (5.2763 => 4.7762, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.56% (2.9384 => 2.6869, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.35% (1.1194 => 1.0483, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3263, std. dev.: 0.0307) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.24% (6.6874 => 6.4040, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.23% (5.3526 => 5.1796, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4877, std. dev.: 0.0353) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.05% (5.3855 => 5.2211, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.29% (2.2022 => 2.1518, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.09% (7.0540 => 6.9774, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 07:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 09:16:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621141602.5E6172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1337?compare_to=1335&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1337, Order: 158915, Start Time: 2012-06-21 13:20:48, End Time: 2012-06-21 14:17:31 To: 1335, Order: 158912, Start Time: 2012-06-21 11:30:27, End Time: 2012-06-21 12:27:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.16% (2.0176 => 2.2832, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.03% (0.5818 => 0.6169, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.83% (0.5748 => 0.6083, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4328 => 0.4579, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.31% (0.7061 => 0.7436, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.7710 => 0.8116, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 4.91% (1.3693 => 1.4366, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0800, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3899 => 0.4087, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.75% (0.3580 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.3489 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.47% (3.9660 => 4.1432, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.6959 => 0.7250, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5265 => 0.5485, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4390 => 0.4567, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9199 => 0.9547, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.3245 => 1.3706, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.44% (16.6129 => 17.1840, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.7038 => 0.7276, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.30% (0.5637 => 0.5823, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.27% (13.8202 => 14.2720, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (3.8646 => 3.9820, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.4563 => 1.4999, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 2.98% (2.1791 => 2.2440, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.2193 => 1.2543, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.87% (0.5577 => 0.5737, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.73% (1.9270 => 1.9796, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5952, std. dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4124, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6135 => 0.6251, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.68% (7.2180 => 7.3395, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7309, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.66% (14.8535 => 15.1001, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.3801 => 4.4462, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (4.4433 => 4.5047, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6499, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2236, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.77% (1.8175 => 2.3040, std. dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.68% (1.2998 => 1.3866, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7229, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: 3.90% (1.9144 => 1.9890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5176, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1394, std. dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.5627 => 20.8930, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.50% (0.6576 => 0.6346, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.8818 => 0.8538, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3177, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std. dev.: 0.0152) MultiSource/Applications/minisat/minisat: -2.59% (9.3358 => 9.0940, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9575, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6987, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9968, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2556, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2344, std. dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8457, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 07:25:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 09:25:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621142520.9C7672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1338?compare_to=1336&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1338, Order: 158915, Start Time: 2012-06-21 13:26:04, End Time: 2012-06-21 14:26:48 To: 1336, Order: 158912, Start Time: 2012-06-21 11:58:28, End Time: 2012-06-21 12:59:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (835 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.36% (0.3473 => 0.3659, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.20% (0.3561 => 0.3746, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.18% (0.3497 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.15% (0.3516 => 0.3697, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.08% (0.3543 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.08% (0.3543 => 0.3723, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 4.98% (0.3694 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.79% (0.3927 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.75% (0.3828 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.68% (0.3886 => 0.4068, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.8172 => 0.8404, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 2.60% (0.5925 => 0.6079, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.47% (0.6030 => 0.6179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7326 => 0.7456, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (10.4361 => 10.5766, std. dev.: 0.0185) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3219, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.31% (0.7835 => 0.7938, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.2024 => 2.2281, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1861 => 1.1985, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (4.9449 => 4.9959, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.03% (1.5603 => 1.5763, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.03% (3.8723 => 3.9120, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 1.02% (2.0273 => 2.0480, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.0018 => 5.0528, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7447, std. dev.: 0.0394) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.78% (0.8651 => 0.7286, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.42% (5.2763 => 4.7792, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.56% (2.9384 => 2.6869, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.62% (1.1194 => 1.0453, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3405, std. dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.30% (6.6874 => 6.3997, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.16% (5.3855 => 5.2151, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.15% (5.3526 => 5.1839, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -3.05% (22.1758 => 21.4997, std. dev.: 0.0428) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.28% (2.2022 => 2.1520, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.05% (0.4879 => 0.4779, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.02% (7.0540 => 6.9817, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 07:31:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 09:31:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621143121.596152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1339?compare_to=1334&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1339, Order: 158912, Start Time: 2012-06-21 12:17:15, End Time: 2012-06-21 14:32:51 To: 1334, Order: 158908, Start Time: 2012-06-21 09:34:55, End Time: 2012-06-21 11:50:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (21 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 5.43% (0.3465 => 0.3653, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.40% (0.3442 => 0.3628, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.40% (0.3446 => 0.3632, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.39% (0.3488 => 0.3676, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.29% (0.3496 => 0.3681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.29% (0.3460 => 0.3643, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.25% (0.3469 => 0.3651, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.02% (0.3643 => 0.3826, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.96% (0.3650 => 0.3831, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.83% (0.3724 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.33% (0.5826 => 0.6020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.09% (0.5889 => 0.6071, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (0.5026 => 0.5170, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.61% (0.7171 => 0.7358, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.5900 => 0.6031, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.05% (1.6211 => 1.6543, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0673 => 2.1045, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.80% (3.5627 => 3.6267, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (1.3152 => 1.3380, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.60% (0.9909 => 1.0068, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.57% (4.2109 => 4.2769, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.49% (2.4764 => 2.3652, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -2.60% (11.9555 => 11.6444, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.4253 => 0.4152, std. dev.: 0.0032) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 08:39:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 10:39:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621153935.F2B0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1340?compare_to=1337&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1340, Order: 158918, Start Time: 2012-06-21 14:44:20, End Time: 2012-06-21 15:41:04 To: 1337, Order: 158915, Start Time: 2012-06-21 13:20:48, End Time: 2012-06-21 14:17:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (747 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.72% (2.0176 => 2.2944, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.5818 => 0.6180, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.10% (0.7061 => 0.7492, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.88% (0.5748 => 0.6086, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.7710 => 0.8100, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/except: 4.89% (0.2760 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.87% (1.9828 => 2.0794, std. dev.: 0.0131) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1416, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.27% (0.6959 => 0.7256, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5265 => 0.5480, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9199 => 0.9543, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.3245 => 1.3719, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 3.47% (16.6129 => 17.1886, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.37% (13.8202 => 14.2860, std. dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.7038 => 0.7272, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5028, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.2193 => 1.2559, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (3.8646 => 3.9771, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2420, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.80% (0.3755 => 0.3860, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.67% (1.9270 => 1.9785, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.7460 => 0.7655, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6020, std. dev.: 0.0108) MultiSource/Applications/spiff/spiff: 2.38% (0.7506 => 0.7685, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.13% (1.3813 => 1.4107, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (1.3819 => 1.4100, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (0.8698 => 0.8870, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (3.6692 => 3.7339, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.67% (7.2180 => 7.3388, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.3801 => 4.4514, std. dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0868, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.1333 => 1.1503, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.36% (4.4433 => 4.5036, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (6.5754 => 6.6585, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.06% (3.1889 => 3.2227, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2658, std. dev.: 0.0532) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.40% (0.9996 => 1.0836, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.23% (2.0200 => 2.1862, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7274, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5851, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1543, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2308 => 1.2445, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.84% (0.4657 => 0.3966, std. dev.: 0.0174) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.59% (22.5627 => 20.8504, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.22% (0.6576 => 0.6364, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5859, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1043, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9563, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.17% (20.3410 => 19.8993, std. dev.: 0.0360) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.86% (28.2225 => 27.6982, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2334, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 08:53:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 10:53:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621155301.81C412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1341?compare_to=1338&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1341, Order: 158918, Start Time: 2012-06-21 14:53:49, End Time: 2012-06-21 15:54:31 To: 1338, Order: 158915, Start Time: 2012-06-21 13:26:04, End Time: 2012-06-21 14:26:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (16 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (843 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (10.2935 => 10.4386, std. dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 4.80% (0.3543 => 0.3713, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.46% (0.3473 => 0.3628, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.32% (0.3497 => 0.3648, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.30% (0.3561 => 0.3714, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.27% (0.3516 => 0.3666, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.26% (0.3543 => 0.3694, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.22% (0.3694 => 0.3850, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.05% (0.3927 => 0.4086, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.02% (0.3828 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.94% (0.3886 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.40% (0.5925 => 0.6067, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.39% (0.6030 => 0.6174, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.60% (0.7326 => 0.7443, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2646 => 4.3141, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 1.12% (2.0273 => 2.0500, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7605, std. dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.14% (0.8651 => 0.7255, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.71% (5.2763 => 4.7639, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.64% (2.9384 => 2.6846, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.75% (1.1194 => 1.0438, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.39% (54.1659 => 51.2464, std. dev.: 0.0312) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3895, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.67% (5.3526 => 5.1563, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.60% (5.3855 => 5.1914, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -3.22% (22.1758 => 21.4612, std. dev.: 0.0230) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.52% (2.2022 => 2.1466, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -2.36% (0.4879 => 0.4764, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.15% (7.0540 => 6.9729, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7411, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.20% (1.1277 => 1.1029, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 10:13:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 12:13:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621171335.CAE9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1342?compare_to=1339&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1342, Order: 158918, Start Time: 2012-06-21 14:59:32, End Time: 2012-06-21 17:15:02 To: 1339, Order: 158912, Start Time: 2012-06-21 12:17:15, End Time: 2012-06-21 14:32:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (21 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 892 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.61% (0.4204 => 0.4818, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.2249 => 0.2398, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 27.06% (0.3792 => 0.4818, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: 5.02% (0.3446 => 0.3619, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.98% (0.3496 => 0.3670, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.96% (0.3465 => 0.3637, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.90% (0.3488 => 0.3659, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.85% (0.3442 => 0.3609, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 4.84% (0.3469 => 0.3637, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.80% (0.3460 => 0.3626, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.52% (0.3650 => 0.3815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.50% (0.3643 => 0.3807, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.35% (0.3724 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.06% (0.5826 => 0.6004, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 2.84% (0.5889 => 0.6056, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 2.34% (0.7171 => 0.7339, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.5900 => 0.6018, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (1.6211 => 1.6526, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.76% (0.9909 => 1.0083, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.72% (2.0673 => 2.1029, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (1.3152 => 1.3361, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (3.5627 => 3.6182, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.45% (4.2109 => 4.2720, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.52% (2.4764 => 2.3644, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -2.76% (11.9555 => 11.6257, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.4253 => 0.4145, std. dev.: 0.0013) Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 10:15:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 12:15:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621171550.E1D952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1343?compare_to=1340&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1343, Order: 158919, Start Time: 2012-06-21 16:20:38, End Time: 2012-06-21 17:17:19 To: 1340, Order: 158918, Start Time: 2012-06-21 14:44:20, End Time: 2012-06-21 15:41:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 6 (6 on baseline) Performance Regressions: 3 (115 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 885 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.63% (0.6364 => 0.6468, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.2675 => 6.3329, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.5028 => 8.5898, std. dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.00% (2.0176 => 2.3000, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.29% (0.5818 => 0.6184, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.05% (0.5748 => 0.6096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7061 => 0.7461, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4328 => 0.4572, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.30% (1.3693 => 1.4419, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (0.7710 => 0.8101, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.95% (0.4062 => 0.4263, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2781 => 0.2917, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.89% (3.9660 => 4.1598, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.5265 => 0.5513, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.67% (0.6959 => 0.7284, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (1.9828 => 2.0720, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.2937 => 0.3069, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.49% (0.2628 => 0.2746, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.3245 => 1.3830, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.38% (0.3107 => 0.3243, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9199 => 0.9590, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.10% (13.8202 => 14.3865, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0594 => 1.1014, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.77% (16.6129 => 17.2394, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.73% (1.4563 => 1.5106, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.69% (0.5637 => 0.5845, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.7038 => 0.7287, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (3.8646 => 3.9970, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (1.1364 => 1.1753, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 3.40% (1.9270 => 1.9925, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.39% (1.1061 => 1.1436, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.35% (0.5577 => 0.5764, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.2193 => 1.2595, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 3.23% (0.8310 => 0.8578, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (13.2842 => 13.6939, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 2.92% (0.7506 => 0.7725, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.7460 => 0.7671, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.80% (1.3813 => 1.4200, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.3819 => 1.4178, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2364, std. dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.53% (0.4379 => 0.4490, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7602, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (7.2180 => 7.3921, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.8698 => 0.8894, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.5754 => 6.7229, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.1333 => 1.1586, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.3801 => 4.4619, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.4433 => 4.5239, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.81% (3.1889 => 3.2467, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.5298 => 14.7524, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4973, std. dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1257, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (8.4961 => 8.5898, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3089, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.5188 => 1.5346, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.19% (1.8175 => 2.2753, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std. dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7177, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5173, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.71% (4.5928 => 4.7172, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1378, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9568, std. dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.46% (0.4657 => 0.4030, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.5627 => 21.0398, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.73% (0.3511 => 0.3380, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.23% (0.9108 => 0.8996, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.68% (9.3358 => 9.0852, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9171, std. dev.: 0.0426) MultiSource/Applications/spiff/spiff: -1.99% (3.0263 => 2.9662, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7046, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2346, std. dev.: 0.0208) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 10:22:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 12:22:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621172233.6D7332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1344?compare_to=1341&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1344, Order: 158919, Start Time: 2012-06-21 16:23:18, End Time: 2012-06-21 17:24:02 To: 1341, Order: 158918, Start Time: 2012-06-21 14:53:49, End Time: 2012-06-21 15:54:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 6 (8 on baseline) Performance Regressions: 10 (40 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 857 (819 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.57% (10.4386 => 11.0198, std. dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.98% (2.1466 => 2.2321, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (6.9729 => 7.2248, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.84% (5.1914 => 5.3390, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (5.1563 => 5.3014, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.36% (21.8816 => 22.3976, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.82% (5.7384 => 5.8429, std. dev.: 0.0197) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.9157 => 8.0423, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (9.4894 => 9.5861, std. dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.30% (1.3089 => 1.3259, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.29% (10.3673 => 11.0198, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/trivial-interface: 5.07% (0.3473 => 0.3649, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.89% (0.3497 => 0.3668, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.83% (0.3561 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.83% (0.3543 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.78% (0.3516 => 0.3684, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.74% (0.3543 => 0.3711, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 4.66% (0.3694 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.58% (0.3927 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.55% (0.3828 => 0.4002, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.45% (0.3886 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.58% (0.5925 => 0.6078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.57% (0.6030 => 0.6185, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (7.0540 => 7.2248, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.10% (21.9371 => 22.3976, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.07% (0.8172 => 0.8341, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 1.83% (0.7835 => 0.7978, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.81% (0.5569 => 0.5670, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.73% (2.0273 => 2.0623, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.61% (4.2646 => 4.3333, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (10.4361 => 10.6028, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.54% (0.8067 => 0.8191, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8429, std. dev.: 0.0197) MultiSource/Applications/Burg/burg: 1.45% (1.1642 => 1.1811, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.1861 => 1.2032, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.38% (3.8723 => 3.9256, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.4186 => 1.4380, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.36% (2.2022 => 2.2321, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.33% (3.3354 => 3.3797, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (5.0018 => 5.0666, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.24% (2.2969 => 2.3254, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.9449 => 5.0056, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.5415 => 1.5598, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.2024 => 2.2282, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (9.4845 => 9.5861, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (8.1363 => 8.2200, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (7.9617 => 8.0423, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7578, std. dev.: 0.0271) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.64% (1.3045 => 1.3259, std. dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 1.30% (3.7781 => 3.8273, std. dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.31% (0.8651 => 0.7240, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.52% (5.2763 => 4.7741, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.20% (2.9384 => 2.6975, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.57% (1.1194 => 1.0458, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2332, std. dev.: 0.0394) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.30% (6.6874 => 6.4000, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -2.75% (22.1758 => 21.5655, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.10% (1.7609 => 1.7416, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 11:39:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 13:39:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621183939.1587B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1345?compare_to=1343&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1345, Order: 158924, Start Time: 2012-06-21 17:44:15, End Time: 2012-06-21 18:41:07 To: 1343, Order: 158919, Start Time: 2012-06-21 16:20:38, End Time: 2012-06-21 17:17:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 6 (0 on baseline) Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 888 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.73% (2.0176 => 2.2947, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.71% (0.5818 => 0.6150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5748 => 0.6064, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.11% (0.7710 => 0.8104, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4328 => 0.4548, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.7061 => 0.7416, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.83% (1.3693 => 1.4354, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.75% (3.9660 => 4.1543, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.68% (0.6959 => 0.7285, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5265 => 0.5505, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4062 => 0.4245, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 4.42% (0.2781 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2782 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.9199 => 0.9579, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.07% (0.2607 => 0.2713, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.06% (0.2761 => 0.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3899 => 0.4057, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2765 => 0.2874, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.94% (13.8202 => 14.3648, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2726 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.0594 => 1.1001, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (1.9828 => 2.0582, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.74% (1.2292 => 1.2752, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 3.73% (0.3107 => 0.3223, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.71% (0.2696 => 0.2796, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.59% (16.6129 => 17.2085, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.7038 => 0.7287, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.4016 => 0.4156, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5637 => 0.5833, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2545, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.41% (0.2988 => 0.3090, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5060, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8646 => 3.9944, std. dev.: 0.0087) MultiSource/Applications/Burg/burg: 3.35% (1.1061 => 1.1432, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.30% (0.5577 => 0.5761, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.2193 => 1.2595, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (1.1364 => 1.1738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.26% (1.9270 => 1.9899, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 3.23% (0.8310 => 0.8578, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4390 => 0.4530, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3868 => 0.3991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3534 => 0.3644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3293 => 0.3395, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (13.2842 => 13.6557, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (3.6692 => 3.7653, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2221, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.43% (1.3819 => 1.4155, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4145, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (7.2180 => 7.3749, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7145, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.3801 => 4.4671, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1333 => 1.1558, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.8698 => 0.8866, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2457, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5199, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 1.50% (1.2749 => 1.2940, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (3.2742 => 3.3197, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.36% (14.5298 => 14.7279, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4800, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.1007 => 2.1267, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (1.5188 => 1.5361, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (8.4961 => 8.5874, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2759, std. dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7261, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9228, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5183, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5855, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1539, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7140, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.14% (0.4657 => 0.4138, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0437, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.13% (0.9108 => 0.9005, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.12% (0.3139 => 0.2947, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0961, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.92% (3.0263 => 2.9682, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7050, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9774, std. dev.: 0.0292) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2568, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2328, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2512, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 11:50:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 13:50:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621185025.AC5732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1346?compare_to=1344&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1346, Order: 158925, Start Time: 2012-06-21 17:51:05, End Time: 2012-06-21 18:51:53 To: 1344, Order: 158919, Start Time: 2012-06-21 16:23:18, End Time: 2012-06-21 17:24:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 6 (0 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 867 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.33% (10.3673 => 11.1271, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 5.61% (0.3473 => 0.3668, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 5.25% (0.3561 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.22% (0.3543 => 0.3728, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.20% (0.3497 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.18% (0.3516 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.17% (0.3543 => 0.3726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 4.98% (0.3694 => 0.3878, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 4.91% (0.3927 => 0.4120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.89% (0.3828 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.79% (0.3886 => 0.4072, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.30% (7.0540 => 7.2867, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 2.90% (0.5925 => 0.6097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.89% (0.6030 => 0.6204, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.18% (0.7326 => 0.7486, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.14% (21.9371 => 22.4069, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (10.4361 => 10.6380, std. dev.: 0.0126) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.93% (2.2022 => 2.2448, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.89% (0.5569 => 0.5674, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.68% (4.2646 => 4.3361, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.67% (2.0273 => 2.0611, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.65% (5.7591 => 5.8541, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.65% (0.8067 => 0.8200, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.65% (3.3354 => 3.3903, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4186 => 1.4414, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.52% (3.8723 => 3.9312, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.46% (0.7835 => 0.7949, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.44% (1.1642 => 1.1810, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.1861 => 1.2032, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.9449 => 5.0157, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5633, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (7.9617 => 8.0732, std. dev.: 0.0139) MultiSource/Applications/siod/siod: 1.35% (2.2969 => 2.3278, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.31% (5.0018 => 5.0671, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.2024 => 2.2303, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (9.4845 => 9.6041, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (8.1363 => 8.2345, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (14.3668 => 14.5346, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5859 => 1.6028, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7682, std. dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.74% (0.8651 => 0.7289, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.23% (5.2763 => 4.7895, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.71% (2.9384 => 2.7118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (1.1194 => 1.0531, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4921, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.07% (6.6874 => 6.4153, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -2.67% (22.1758 => 21.5844, std. dev.: 0.0264) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 12:55:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 14:55:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621195558.C03232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1347?compare_to=1342&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1347, Order: 158924, Start Time: 2012-06-21 17:41:54, End Time: 2012-06-21 19:57:28 To: 1342, Order: 158918, Start Time: 2012-06-21 14:59:32, End Time: 2012-06-21 17:15:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (22 on baseline) Performance Improvements: 0 (4 on baseline) Unchanged Tests: 894 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 19.86% (0.3792 => 0.4545, std. dev.: 0.0201) SingleSource/UnitTests/ObjC/exceptions-2: 5.14% (0.3446 => 0.3623, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.13% (0.3488 => 0.3667, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 5.12% (0.3460 => 0.3637, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.08% (0.3465 => 0.3641, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.06% (0.3442 => 0.3616, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 4.95% (0.3496 => 0.3669, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.93% (0.3469 => 0.3640, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.89% (0.3643 => 0.3821, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 4.77% (0.3650 => 0.3824, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.62% (0.3724 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.76% (0.5826 => 0.5987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.50% (0.5889 => 0.6036, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (0.5026 => 0.5135, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 2.01% (0.7171 => 0.7315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.5900 => 0.6013, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.64% (1.6211 => 1.6477, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.48% (2.0673 => 2.0979, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.40% (0.9909 => 1.0048, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (1.3152 => 1.3323, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.28% (4.2109 => 4.2649, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (3.5627 => 3.6078, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.26% (2.4764 => 2.3709, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -3.06% (11.9555 => 11.5901, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.4253 => 0.4149, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.09% (2.0820 => 2.0594, std. dev.: 0.0071) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 13:03:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 15:03:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621200316.B90352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1348?compare_to=1345&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1348, Order: 158927, Start Time: 2012-06-21 19:07:57, End Time: 2012-06-21 20:04:45 To: 1345, Order: 158924, Start Time: 2012-06-21 17:44:15, End Time: 2012-06-21 18:41:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.73% (1.3907 => 1.4147, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.68% (2.0176 => 2.2936, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4328 => 0.4547, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7710 => 0.8097, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 4.90% (0.5818 => 0.6103, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (3.9660 => 4.1561, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.70% (1.3693 => 1.4337, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4062 => 0.4250, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.63% (0.5748 => 0.6014, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.43% (0.7061 => 0.7374, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.3245 => 1.3825, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.9199 => 0.9585, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.14% (0.2781 => 0.2896, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3899 => 0.4059, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.08% (13.8202 => 14.3844, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2782 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.0594 => 1.1018, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.97% (0.3022 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2966 => 0.3081, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.85% (0.2937 => 0.3050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.84% (0.2607 => 0.2707, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2726 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.81% (0.2628 => 0.2728, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2655 => 0.2756, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.80% (0.3580 => 0.3716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.79% (0.2690 => 0.2792, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.78% (1.9828 => 2.0577, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2760 => 0.2864, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.76% (1.2292 => 1.2754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.68% (0.3149 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.67% (0.3107 => 0.3221, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.4563 => 1.5075, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.50% (2.1791 => 2.2553, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (3.8646 => 3.9969, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.5637 => 0.5829, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.1364 => 1.1748, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.37% (16.6129 => 17.1731, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.35% (1.9270 => 1.9916, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.2193 => 1.2601, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3192 => 0.3298, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.31% (0.8310 => 0.8585, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.27% (0.7038 => 0.7268, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.25% (1.1061 => 1.1421, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3756 => 0.3875, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3868 => 0.3988, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (13.2842 => 13.6957, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists1: 3.06% (0.3534 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3293 => 0.3393, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.88% (1.3813 => 1.4211, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.3819 => 1.4217, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 2.84% (0.7506 => 0.7719, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7460 => 0.7667, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.8535 => 15.2504, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7442, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.56% (3.6692 => 3.7633, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6135 => 0.6283, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.37% (7.2180 => 7.3889, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8698 => 0.8872, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1333 => 1.1559, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.99% (3.1889 => 3.2524, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4649, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.2749 => 1.2985, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.84% (16.2614 => 16.5601, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.4433 => 4.5236, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 1.68% (14.5298 => 14.7739, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (3.2742 => 3.3179, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1283, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (8.4961 => 8.6061, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.18% (1.0313 => 1.0435, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.54% (1.8175 => 2.2999, std. dev.: 0.0388) SingleSource/Benchmarks/Misc/mandel-2: 8.84% (1.2998 => 1.4147, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1901, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7307, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5166, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7145, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1302, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.74% (0.4657 => 0.4157, std. dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0442, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.04% (0.3511 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (0.9108 => 0.9007, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5864, std. dev.: 0.0113) MultiSource/Applications/minisat/minisat: -2.25% (9.3358 => 9.1256, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/health/health: -2.23% (0.4533 => 0.4432, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9256, std. dev.: 0.0374) MultiSource/Applications/spiff/spiff: -1.98% (3.0263 => 2.9663, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7069, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2579, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2321, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8694, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 13:18:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 15:18:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621201816.EE7372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1349?compare_to=1346&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1349, Order: 158929, Start Time: 2012-06-21 19:18:52, End Time: 2012-06-21 20:19:46 To: 1346, Order: 158925, Start Time: 2012-06-21 17:51:05, End Time: 2012-06-21 18:51:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 1 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.49% (11.1271 => 10.7386, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.05% (0.3543 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.63% (0.3561 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.49% (0.3516 => 0.3674, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.49% (0.3497 => 0.3654, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.43% (0.3543 => 0.3700, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.30% (0.3694 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.28% (0.3927 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.21% (0.3828 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.14% (0.3886 => 0.4047, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.58% (10.3673 => 10.7386, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.73% (7.0540 => 7.2468, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 2.12% (0.6030 => 0.6158, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.8172 => 0.8342, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 2.06% (0.5925 => 0.6047, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (10.4361 => 10.6445, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (2.2022 => 2.2419, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.76% (21.9371 => 22.3231, std. dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.71% (0.5860 => 0.5960, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.70% (5.7591 => 5.8571, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (4.2646 => 4.3253, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 1.42% (0.7326 => 0.7430, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.39% (2.0273 => 2.0554, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0116, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.4186 => 1.4377, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5611, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 1.25% (3.8723 => 3.9208, std. dev.: 0.0117) MultiSource/Applications/d/make_dparser: 1.23% (3.3354 => 3.3765, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1861 => 1.2005, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.0018 => 5.0569, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (9.4845 => 9.5872, std. dev.: 0.0155) MultiSource/Applications/siod/siod: 1.03% (2.2969 => 2.3205, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.45% (26.0924 => 26.7321, std. dev.: 0.0439) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.82% (0.8651 => 0.7282, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.35% (5.2763 => 4.7830, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.04% (2.9384 => 2.7022, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (1.1194 => 1.0490, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4963, std. dev.: 0.0309) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.14% (6.6874 => 6.4104, std. dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -2.87% (22.1758 => 21.5397, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.03% (1.7609 => 1.7427, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 14:27:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 16:27:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621212702.B27BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1350?compare_to=1348&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1350, Order: 158931, Start Time: 2012-06-21 20:31:39, End Time: 2012-06-21 21:28:31 To: 1348, Order: 158927, Start Time: 2012-06-21 19:07:57, End Time: 2012-06-21 20:04:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.7710 => 0.8114, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4328 => 0.4554, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.07% (0.4062 => 0.4268, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.01% (1.3693 => 1.4379, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 4.97% (0.5818 => 0.6107, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 4.80% (0.5748 => 0.6024, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.80% (3.9660 => 4.1564, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.6959 => 0.7288, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5265 => 0.5509, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.59% (0.7061 => 0.7385, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.3245 => 1.3851, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.9199 => 0.9597, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.28% (0.3899 => 0.4066, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3022 => 0.3150, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.2966 => 0.3091, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.2937 => 0.3060, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.06% (13.8202 => 14.3807, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.03% (1.9828 => 2.0627, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2765 => 0.2875, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2778, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.93% (0.2696 => 0.2802, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.90% (1.0594 => 1.1007, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3149 => 0.3271, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3489 => 0.3623, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3485 => 0.3618, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.72% (2.1791 => 2.2602, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0033, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.56% (1.1061 => 1.1455, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.3756 => 0.3889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.54% (0.3192 => 0.3305, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.49% (16.6129 => 17.1929, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5637 => 0.5833, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5066, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5577 => 0.5766, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.1364 => 1.1748, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.38% (1.9270 => 1.9921, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.2193 => 1.2602, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.7038 => 0.7273, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 3.29% (0.8310 => 0.8583, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: 3.28% (0.3868 => 0.3995, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3534 => 0.3650, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4390 => 0.4534, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.28% (0.7506 => 0.7752, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (13.2842 => 13.6604, std. dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2707, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7607, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (1.3813 => 1.4154, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.42% (1.1333 => 1.1607, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.39% (7.2180 => 7.3908, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (1.3819 => 1.4145, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6135 => 0.6278, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.5754 => 6.7238, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4664, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 1.90% (3.1889 => 3.2496, std. dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.4433 => 4.5273, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6283 => 0.6397, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (1.2749 => 1.2959, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.50% (14.5298 => 14.7484, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4914, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3152, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (2.1007 => 2.1269, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5188 => 1.5364, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (8.4961 => 8.5944, std. dev.: 0.0075) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0429, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/mandel-2: 8.88% (1.2998 => 1.4152, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1905, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7188, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5170, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5856, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1489, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.71% (4.5928 => 4.7173, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.5184 => 0.5308, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1921, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.70% (0.4657 => 0.3926, std. dev.: 0.0212) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0129, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.07% (0.3511 => 0.3368, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.61% (9.3358 => 9.0922, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.45% (8.8259 => 8.6093, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.02% (3.0263 => 2.9652, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9306, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2542, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4871, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.40% (7.3305 => 7.2280, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 14:46:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 16:46:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621214610.BC5A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1351?compare_to=1349&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1351, Order: 158932, Start Time: 2012-06-21 20:46:48, End Time: 2012-06-21 21:47:39 To: 1349, Order: 158929, Start Time: 2012-06-21 19:18:52, End Time: 2012-06-21 20:19:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.44% (0.3473 => 0.3662, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.22% (0.3543 => 0.3728, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.20% (0.3497 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.14% (0.3543 => 0.3725, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.12% (0.3516 => 0.3696, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.11% (0.3561 => 0.3743, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.02% (0.3927 => 0.4124, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.98% (0.3694 => 0.3878, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 4.75% (0.3828 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.73% (0.3886 => 0.4070, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.55% (10.3673 => 10.7355, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.8172 => 0.8388, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (7.0540 => 7.2387, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 2.38% (0.5925 => 0.6066, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.37% (0.6030 => 0.6173, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (10.4361 => 10.6455, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.80% (0.5569 => 0.5669, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.77% (2.2022 => 2.2412, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.72% (21.9371 => 22.3154, std. dev.: 0.0203) SingleSource/UnitTests/ObjC++/property-reference: 1.62% (0.7326 => 0.7445, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.9449 => 5.0194, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4395, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7591 => 5.8427, std. dev.: 0.0055) MultiSource/Applications/lua/lua: 1.41% (3.8723 => 3.9268, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2646 => 4.3245, std. dev.: 0.0087) MultiSource/Applications/spiff/spiff: 1.39% (0.7835 => 0.7944, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.39% (2.0273 => 2.0554, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.5415 => 1.5623, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (5.0018 => 5.0644, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 1.24% (3.3354 => 3.3767, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (9.4845 => 9.6010, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.1363 => 8.2339, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1861 => 1.1999, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.04% (2.2969 => 2.3208, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (7.9617 => 8.0439, std. dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.45% (26.0924 => 26.7309, std. dev.: 0.0322) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.04% (0.8651 => 0.7263, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7842, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (2.9384 => 2.7046, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.06% (1.1194 => 1.0516, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4839, std. dev.: 0.0289) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.00% (6.6874 => 6.4197, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -2.86% (22.1758 => 21.5405, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.08% (1.7609 => 1.7419, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 15:38:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 17:38:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120621223804.526142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1352?compare_to=1347&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1352, Order: 158931, Start Time: 2012-06-21 20:24:11, End Time: 2012-06-21 22:39:33 To: 1347, Order: 158924, Start Time: 2012-06-21 17:41:54, End Time: 2012-06-21 19:57:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (23 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.34% (2.0594 => 2.0869, std. dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.65% (0.3488 => 0.3720, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 6.55% (0.3465 => 0.3692, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3446 => 0.3671, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.50% (0.3460 => 0.3685, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 6.43% (0.3469 => 0.3692, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.42% (0.3442 => 0.3663, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.38% (0.3496 => 0.3719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.18% (0.3643 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.08% (0.3650 => 0.3872, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.07% (0.3724 => 0.3950, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5826 => 0.6023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.5889 => 0.6076, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (0.5026 => 0.5160, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7171 => 0.7350, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.5900 => 0.6034, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.04% (1.6211 => 1.6542, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (3.5627 => 3.6290, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.63% (4.2109 => 4.2795, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (1.3152 => 1.3335, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (2.0673 => 2.0931, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.17% (0.9909 => 1.0025, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.13% (1.5932 => 1.6112, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.16% (2.4764 => 2.3734, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: -2.96% (11.9555 => 11.6022, std. dev.: 0.0184) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 15:50:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 17:50:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120621225040.57AA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1353?compare_to=1350&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1353, Order: 158936, Start Time: 2012-06-21 21:55:21, End Time: 2012-06-21 22:52:05 To: 1350, Order: 158931, Start Time: 2012-06-21 20:31:39, End Time: 2012-06-21 21:28:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.71% (0.5818 => 0.6150, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.53% (0.7710 => 0.8136, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5748 => 0.6064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7061 => 0.7430, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.13% (0.4328 => 0.4550, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (3.9660 => 4.1591, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.57% (0.6959 => 0.7277, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.2781 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.46% (0.4062 => 0.4243, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 4.40% (1.3693 => 1.4295, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.23% (0.3899 => 0.4064, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.20% (0.3022 => 0.3149, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.2966 => 0.3090, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9199 => 0.9572, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.9828 => 2.0624, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.94% (1.3245 => 1.3767, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3580 => 0.3721, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.89% (0.2696 => 0.2801, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2760 => 0.2867, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.84% (13.8202 => 14.3512, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/random: 3.83% (0.2690 => 0.2793, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.2937 => 0.3049, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2292 => 1.2758, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 3.77% (0.3107 => 0.3224, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3489 => 0.3617, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (0.3485 => 0.3612, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3453 => 0.3575, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.4563 => 1.5072, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.4016 => 0.4156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.48% (0.2988 => 0.3092, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.47% (16.6129 => 17.1891, std. dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (3.8646 => 3.9952, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.38% (1.0594 => 1.0952, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.30% (2.1791 => 2.2510, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 3.28% (1.1061 => 1.1424, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.25% (0.3789 => 0.3912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.25% (0.5577 => 0.5758, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4390 => 0.4531, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7038 => 0.7263, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 3.19% (0.3663 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.17% (0.3914 => 0.4038, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3293 => 0.3397, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 3.15% (0.3646 => 0.3761, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.14% (0.3601 => 0.3714, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.13% (1.1364 => 1.1720, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.08% (1.9270 => 1.9863, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8310 => 0.8559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.95% (0.3868 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.93% (0.3650 => 0.3757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 2.93% (0.3623 => 0.3729, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (13.2842 => 13.6489, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (1.3813 => 1.4154, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4379 => 0.4483, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4146, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (3.6692 => 3.7557, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (7.2180 => 7.3852, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1963, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (6.5754 => 6.7040, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1550, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.3801 => 4.4600, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5153, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.51% (3.1889 => 3.2370, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6982, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.2742 => 3.3080, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2691, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4072, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7380, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5843, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1426, std. dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.5928 => 4.7150, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9704, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.13% (0.4657 => 0.3906, std. dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8831, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.70% (0.3511 => 0.3381, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5822, std. dev.: 0.0141) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1072, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9317, std. dev.: 0.0382) MultiSource/Applications/spiff/spiff: -1.95% (3.0263 => 2.9674, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7066, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 16:14:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 18:14:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120621231410.9369F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1354?compare_to=1351&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1354, Order: 158939, Start Time: 2012-06-21 22:14:39, End Time: 2012-06-21 23:15:39 To: 1351, Order: 158932, Start Time: 2012-06-21 20:46:48, End Time: 2012-06-21 21:47:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (33 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (10.7355 => 10.9868, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 2.21% (0.7462 => 0.7627, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.98% (10.3673 => 10.9868, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3543 => 0.3749, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 5.53% (0.3473 => 0.3665, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.18% (0.3516 => 0.3698, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.17% (0.3543 => 0.3726, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 5.15% (0.3497 => 0.3677, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.11% (0.3561 => 0.3743, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 4.91% (0.3927 => 0.4120, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 4.86% (0.3828 => 0.4014, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 4.85% (0.3694 => 0.3873, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 4.68% (0.3886 => 0.4068, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.08% (7.0540 => 7.2716, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7433 => 0.7627, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (10.4361 => 10.6690, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.16% (21.9371 => 22.4109, std. dev.: 0.0198) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.13% (2.2022 => 2.2492, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.8172 => 0.8332, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 1.67% (0.6030 => 0.6131, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.55% (4.2646 => 4.3307, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.44% (0.8067 => 0.8183, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (4.9449 => 5.0145, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.32% (5.7591 => 5.8352, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.32% (1.4186 => 1.4373, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.30% (1.5415 => 1.5616, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1861 => 1.2005, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (8.1363 => 8.2271, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 1.10% (1.1642 => 1.1770, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (9.4845 => 9.5877, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0557, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.02% (3.3354 => 3.3693, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (7.9617 => 8.0420, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7812, std. dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.03% (0.8651 => 0.7264, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.17% (5.2763 => 4.7926, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (2.9384 => 2.7124, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (1.1194 => 1.0523, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3190, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.95% (6.6874 => 6.4234, std. dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: -2.78% (22.1758 => 21.5592, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 17:14:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 19:14:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622001410.AA8BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1355?compare_to=1353&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1355, Order: 158943, Start Time: 2012-06-21 23:18:56, End Time: 2012-06-22 00:15:39 To: 1353, Order: 158936, Start Time: 2012-06-21 21:55:21, End Time: 2012-06-21 22:52:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (100 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (755 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9434 => 5.1112, std. dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (0.7263 => 0.7428, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2315 => 1.2457, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.48% (0.7430 => 0.7320, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.54% (0.7038 => 0.7428, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.77% (3.9660 => 4.1553, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.7710 => 0.8075, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.67% (0.4328 => 0.4530, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.35% (0.5818 => 0.6071, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3245 => 1.3772, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2781 => 0.2891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.95% (0.5748 => 0.5975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.3899 => 0.4051, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.89% (0.4062 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9199 => 0.9543, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.74% (0.3022 => 0.3135, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.74% (13.8202 => 14.3366, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 3.67% (0.7061 => 0.7320, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3580 => 0.3711, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2966 => 0.3072, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3489 => 0.3611, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.2937 => 0.3038, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.35% (1.9828 => 2.0493, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3107 => 0.3209, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.26% (16.6129 => 17.1544, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2692, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.4563 => 1.5031, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (3.8646 => 3.9885, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.16% (0.3485 => 0.3595, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.15% (2.1791 => 2.2478, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.2193 => 1.2567, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.04% (1.1061 => 1.1397, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3453 => 0.3557, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.01% (1.9270 => 1.9850, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.1364 => 1.1705, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.96% (0.4016 => 0.4135, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.3756 => 0.3863, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (13.2842 => 13.6497, std. dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4390 => 0.4510, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (0.7460 => 0.7649, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1112, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (1.3813 => 1.4153, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (1.3819 => 1.4148, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.36% (0.7506 => 0.7683, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3811, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (3.6692 => 3.7520, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.26% (14.8535 => 15.1885, std. dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.5754 => 6.7063, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.1333 => 1.1529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4527, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (4.4433 => 4.5101, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.46% (3.1889 => 3.2356, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.8698 => 0.8815, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1265, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3135, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7022, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4266, std. dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 25.63% (1.8175 => 2.2833, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4032, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7284, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (2.8606 => 2.9611, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.04% (7.9275 => 8.1681, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5868, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.62% (4.5928 => 4.7132, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (0.5184 => 0.5298, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.2308 => 1.2457, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.60% (0.4657 => 0.3884, std. dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9295, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.70% (0.3511 => 0.3381, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0127) MultiSource/Applications/minisat/minisat: -2.46% (9.3358 => 9.1061, std. dev.: 0.0274) MultiSource/Applications/spiff/spiff: -1.93% (3.0263 => 2.9680, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9528, std. dev.: 0.0267) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7051, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2470, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2344, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (9.9194 => 9.8199, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 17:42:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 19:42:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622004211.5F6B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1356?compare_to=1354&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1356, Order: 158946, Start Time: 2012-06-21 23:42:43, End Time: 2012-06-22 00:43:39 To: 1354, Order: 158939, Start Time: 2012-06-21 22:14:39, End Time: 2012-06-21 23:15:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (23 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (841 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.35% (10.3673 => 10.9224, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 4.58% (0.3473 => 0.3632, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.49% (0.3561 => 0.3721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.43% (0.3497 => 0.3652, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.43% (0.3543 => 0.3700, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 4.40% (0.3543 => 0.3699, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.32% (0.3516 => 0.3668, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.25% (0.3694 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.15% (0.3828 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.02% (0.3927 => 0.4085, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.96% (0.3886 => 0.4040, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.8172 => 0.8418, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (7.0540 => 7.2568, std. dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (0.7433 => 0.7632, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.96% (21.9371 => 22.3671, std. dev.: 0.0184) MultiSource/Applications/JM/ldecod/ldecod: 1.92% (10.4361 => 10.6369, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (2.2022 => 2.2407, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.44% (4.9449 => 5.0161, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (4.2646 => 4.3224, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 1.22% (2.0273 => 2.0520, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (7.9617 => 8.0553, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 1.05% (5.7591 => 5.8195, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7672, std. dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.85% (0.8651 => 0.7280, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.29% (5.2763 => 4.7863, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (2.9384 => 2.7039, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.08% (1.1194 => 1.0513, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3278, std. dev.: 0.0354) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.83% (6.6874 => 6.4310, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -2.82% (22.1758 => 21.5505, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.02% (1.7609 => 1.7430, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 18:20:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 20:20:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622012007.A5F212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1357?compare_to=1352&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1357, Order: 158943, Start Time: 2012-06-21 23:06:14, End Time: 2012-06-22 01:21:37 To: 1352, Order: 158931, Start Time: 2012-06-21 20:24:11, End Time: 2012-06-21 22:39:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (25 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 892 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 10.56% (0.3995 => 0.4417, std. dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: 4.18% (2.3734 => 2.4725, std. dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 16.48% (0.3792 => 0.4417, std. dev.: 0.0109) SingleSource/UnitTests/ObjC/exceptions-2: 6.07% (0.3446 => 0.3655, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3488 => 0.3699, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3465 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.95% (0.3460 => 0.3666, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3442 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.88% (0.3469 => 0.3673, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.81% (0.3496 => 0.3699, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 5.65% (0.3643 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.51% (0.3650 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.34% (0.3724 => 0.3923, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (0.5026 => 0.5160, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (1.6211 => 1.6607, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/Hello: 2.27% (0.5826 => 0.5958, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.5900 => 0.6032, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 2.17% (0.5889 => 0.6017, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (3.5627 => 3.6355, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (1.3152 => 1.3394, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7171 => 0.7292, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.50% (4.2109 => 4.2740, std. dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 1.18% (23.5202 => 23.7969, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.16% (2.0673 => 2.0913, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.06% (0.9909 => 1.0014, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.05% (1.5932 => 1.6100, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.86% (11.9555 => 11.6139, std. dev.: 0.0046) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 18:37:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 20:37:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622013748.BFCBD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1358?compare_to=1355&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1358, Order: 158951, Start Time: 2012-06-22 00:42:31, End Time: 2012-06-22 01:39:17 To: 1355, Order: 158943, Start Time: 2012-06-21 23:18:56, End Time: 2012-06-22 00:15:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.73% (0.7038 => 0.7441, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.25% (1.3693 => 1.4412, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.15% (0.7710 => 0.8107, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (3.9660 => 4.1584, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.4062 => 0.4254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.57% (0.5818 => 0.6084, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.57% (0.6959 => 0.7277, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.49% (0.2607 => 0.2724, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2782 => 0.2905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.37% (0.5748 => 0.5999, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.31% (1.3245 => 1.3816, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.29% (0.2655 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2726 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.28% (0.2966 => 0.3093, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.20% (0.2761 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3580 => 0.3730, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.18% (0.7061 => 0.7356, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.17% (1.9828 => 2.0654, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.12% (0.9199 => 0.9578, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3485 => 0.3627, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.07% (13.8202 => 14.3822, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.04% (0.3489 => 0.3630, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3192 => 0.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.0594 => 1.0983, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.4563 => 1.5087, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (0.3756 => 0.3887, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2546, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.39% (3.8646 => 3.9958, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4390 => 0.4539, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.35% (0.5577 => 0.5764, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3534 => 0.3652, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.2193 => 1.2599, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (1.1364 => 1.1742, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.32% (16.6129 => 17.1652, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.29% (1.9270 => 1.9904, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 3.16% (0.8310 => 0.8573, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1411, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.98% (1.3813 => 1.4224, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (13.2842 => 13.6733, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.87% (1.3819 => 1.4215, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7460 => 0.7667, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.70% (4.9865 => 5.1212, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (3.6692 => 3.7651, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2248, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.38% (7.2180 => 7.3899, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.20% (6.5754 => 6.7199, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8698 => 0.8868, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.90% (3.1889 => 3.2496, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1333 => 1.1547, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.3801 => 4.4620, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.71% (4.4433 => 4.5195, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.64% (14.5298 => 14.7682, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5259, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.4961 => 8.6072, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (2.1007 => 2.1275, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3142, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5188 => 1.5364, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3463, std. dev.: 0.0087) MultiSource/Applications/lemon/lemon: 1.03% (1.0313 => 1.0419, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7362, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9227, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5172, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5864, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1442, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 2.72% (4.5928 => 4.7178, std. dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.45% (0.8273 => 0.8393, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std. dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (22.5627 => 21.0048, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3511 => 0.3373, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.8818 => 0.8572, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5830, std. dev.: 0.0115) MultiSource/Applications/minisat/minisat: -2.66% (9.3358 => 9.0878, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8852, std. dev.: 0.0452) MultiSource/Applications/spiff/spiff: -1.91% (3.0263 => 2.9686, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7053, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5126, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2256, std. dev.: 0.0247) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (0.9692 => 0.9573, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (9.9194 => 9.8182, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 19:10:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 21:10:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622021003.11BC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1359?compare_to=1356&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1359, Order: 158954, Start Time: 2012-06-22 01:10:35, End Time: 2012-06-22 02:11:32 To: 1356, Order: 158946, Start Time: 2012-06-21 23:42:43, End Time: 2012-06-22 00:43:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (35 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 4.98% (0.3473 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.91% (0.3543 => 0.3717, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 4.86% (0.3497 => 0.3667, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.83% (0.3543 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.75% (0.3516 => 0.3683, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 4.72% (0.3561 => 0.3729, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.58% (0.3927 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.57% (0.3694 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.49% (0.3828 => 0.4000, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.43% (0.3886 => 0.4058, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 4.32% (10.3673 => 10.8156, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.7433 => 0.7652, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.8172 => 0.8389, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (7.0540 => 7.2158, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5569 => 0.5676, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (10.4361 => 10.6208, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.72% (21.9371 => 22.3149, std. dev.: 0.0250) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.61% (4.2646 => 4.3331, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.60% (0.7835 => 0.7960, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.50% (2.0273 => 2.0578, std. dev.: 0.0118) MultiSource/Applications/Burg/burg: 1.49% (1.1642 => 1.1815, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 1.40% (5.7591 => 5.8400, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.28% (0.8067 => 0.8170, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.26% (1.5415 => 1.5609, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.25% (4.9449 => 5.0067, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.25% (3.3354 => 3.3770, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.23% (1.4186 => 1.4361, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (5.0018 => 5.0601, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (2.2022 => 2.2266, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (3.8723 => 3.9142, std. dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1861 => 1.1986, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.00% (2.2969 => 2.3199, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.57% (26.0924 => 26.7619, std. dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3193, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.77% (0.8651 => 0.7287, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.17% (5.2763 => 4.7926, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.95% (2.9384 => 2.7049, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.36% (1.1194 => 1.0482, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3482, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.14% (6.6874 => 6.4107, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -3.00% (22.1758 => 21.5110, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 20:01:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 22:01:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622030127.EC34E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1360?compare_to=1358&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1360, Order: 158957, Start Time: 2012-06-22 02:06:05, End Time: 2012-06-22 03:02:56 To: 1358, Order: 158951, Start Time: 2012-06-22 00:42:31, End Time: 2012-06-22 01:39:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (728 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.41% (0.7356 => 0.7460, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.31% (10.8296 => 10.9718, std. dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.87% (2.0176 => 2.2975, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.5818 => 0.6183, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5748 => 0.6095, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.81% (0.7038 => 0.7447, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7061 => 0.7460, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.59% (0.2721 => 0.2873, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.51% (1.3693 => 1.4448, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.2596 => 0.2737, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.14% (3.9660 => 4.1699, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 5.07% (0.4062 => 0.4268, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.84% (0.5265 => 0.5520, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.77% (0.6959 => 0.7291, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.3489 => 0.3653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.66% (1.9828 => 2.0752, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.51% (0.3192 => 0.3336, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3834, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9199 => 0.9590, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.07% (13.8202 => 14.3825, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.06% (0.4016 => 0.4179, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.3756 => 0.3906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.93% (1.0594 => 1.1010, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.84% (16.6129 => 17.2511, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4390 => 0.4552, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 3.67% (3.8646 => 4.0063, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.59% (1.4563 => 1.5086, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.2193 => 1.2624, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5577 => 0.5772, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.48% (2.1791 => 2.2550, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5637 => 0.5833, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.1364 => 1.1759, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.45% (1.9270 => 1.9934, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.33% (1.1061 => 1.1429, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.24% (0.8310 => 0.8579, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (13.2842 => 13.7113, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.7460 => 0.7688, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.01% (0.3914 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.00% (0.4003 => 0.4123, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.98% (1.3813 => 1.4224, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.3819 => 1.4228, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.92% (0.7506 => 0.7725, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.90% (3.6692 => 3.7755, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 2.89% (0.3601 => 0.3705, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 2.88% (0.3789 => 0.3898, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2623, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 2.74% (0.3646 => 0.3746, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.67% (7.2180 => 7.4105, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 2.66% (0.3940 => 0.4045, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (4.9865 => 5.1186, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4379 => 0.4489, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7373, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.6135 => 0.6280, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1592, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (4.3801 => 4.4729, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.09% (3.1889 => 3.2556, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.96% (4.4433 => 4.5302, std. dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 1.84% (14.5298 => 14.7969, std. dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5088, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (8.4961 => 8.6064, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1265, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.2785 => 6.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3107, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.03% (1.0313 => 1.0419, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0543) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.12% (2.0200 => 2.1840, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.90% (1.9144 => 1.9891, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7115, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1570, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5862, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7137, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9718, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.35% (1.4298 => 1.4491, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1932, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9532, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.70% (0.4657 => 0.4112, std. dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9846, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5515, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.61% (9.3358 => 9.0925, std. dev.: 0.0324) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5969, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.04% (3.0263 => 2.9646, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9539, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7081, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2354, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (9.9194 => 9.8199, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 20:38:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 22:38:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622033802.8504A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1361?compare_to=1359&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1361, Order: 158957, Start Time: 2012-06-22 02:38:33, End Time: 2012-06-22 03:39:32 To: 1359, Order: 158954, Start Time: 2012-06-22 01:10:35, End Time: 2012-06-22 02:11:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (35 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.00% (10.8156 => 11.1397, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (10.3673 => 11.1397, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3473 => 0.3679, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3497 => 0.3704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.67% (0.3561 => 0.3763, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 5.66% (0.3516 => 0.3715, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3543 => 0.3742, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3543 => 0.3741, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 5.39% (0.3694 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.30% (0.3828 => 0.4031, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.19% (0.3927 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.02% (0.3886 => 0.4081, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.8172 => 0.8414, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 2.70% (0.5925 => 0.6085, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 2.60% (0.6030 => 0.6187, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (7.0540 => 7.2244, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.08% (0.5569 => 0.5685, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.01% (0.7326 => 0.7473, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.71% (21.9371 => 22.3130, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 1.69% (10.4361 => 10.6125, std. dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.60% (4.2646 => 4.3327, std. dev.: 0.0107) MultiSource/Applications/treecc/treecc: 1.33% (2.0273 => 2.0543, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 1.25% (1.1642 => 1.1788, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8308, std. dev.: 0.0151) MultiSource/Applications/d/make_dparser: 1.18% (3.3354 => 3.3748, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.18% (2.2022 => 2.2282, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.14% (3.8723 => 3.9163, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.13% (1.4186 => 1.4347, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.1861 => 1.1993, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (4.9449 => 4.9997, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.10% (1.5415 => 1.5584, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (8.1363 => 8.2239, std. dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (7.9617 => 8.0468, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (5.0018 => 5.0541, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7656, std. dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.21% (0.8651 => 0.7249, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.49% (5.2763 => 4.7754, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.12% (2.9384 => 2.6997, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0467, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3032, std. dev.: 0.0242) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.83% (6.6874 => 6.4313, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -2.83% (22.1758 => 21.5480, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 21:02:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 23:02:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622040224.D344D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1362?compare_to=1357&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1362, Order: 158956, Start Time: 2012-06-22 01:48:24, End Time: 2012-06-22 04:03:54 To: 1357, Order: 158943, Start Time: 2012-06-21 23:06:14, End Time: 2012-06-22 01:21:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (25 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 893 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.08% (2.4725 => 2.3964, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3465 => 0.3693, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.56% (0.3446 => 0.3672, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 6.51% (0.3469 => 0.3695, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.50% (0.3460 => 0.3685, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3442 => 0.3665, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.39% (0.3488 => 0.3711, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 6.35% (0.3496 => 0.3718, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.07% (0.3643 => 0.3864, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.95% (0.3650 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.85% (0.3724 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.30% (0.5826 => 0.6018, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.07% (0.5889 => 0.6070, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7171 => 0.7354, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.32% (1.6211 => 1.6587, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (0.5026 => 0.5139, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.5900 => 0.6029, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (3.5627 => 3.6334, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.78% (1.5932 => 1.6215, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0673 => 2.1039, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (1.3152 => 1.3381, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 1.63% (4.2109 => 4.2794, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.52% (0.9909 => 1.0060, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.19% (23.5202 => 23.8001, std. dev.: 0.0111) MultiSource/Applications/d/make_dparser: 1.11% (1.0781 => 1.0901, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.23% (2.4764 => 2.3964, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -2.76% (11.9555 => 11.6251, std. dev.: 0.0054) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 21:25:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 21 Jun 2012 23:25:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622042511.ED76A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1363?compare_to=1360&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1363, Order: 158960, Start Time: 2012-06-22 03:29:49, End Time: 2012-06-22 04:26:41 To: 1360, Order: 158957, Start Time: 2012-06-22 02:06:05, End Time: 2012-06-22 03:02:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.52% (3.8296 => 3.7713, std. dev.: 0.0080) MultiSource/Applications/SPASS/SPASS: -1.23% (10.9718 => 10.8364, std. dev.: 0.0251) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2845, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.79% (0.5818 => 0.6155, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.43% (0.7038 => 0.7420, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 5.41% (0.5748 => 0.6059, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 5.24% (1.3693 => 1.4411, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (0.7710 => 0.8106, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 5.11% (0.4328 => 0.4549, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.07% (0.7061 => 0.7419, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (3.9660 => 4.1560, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5265 => 0.5515, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4062 => 0.4241, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.6959 => 0.7265, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3022 => 0.3152, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.28% (0.2781 => 0.2900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.21% (0.3899 => 0.4063, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3580 => 0.3726, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.06% (0.3107 => 0.3233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2655 => 0.2762, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.02% (1.9828 => 2.0626, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.3245 => 1.3771, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.95% (0.9199 => 0.9562, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2760 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.85% (13.8202 => 14.3520, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3485 => 0.3617, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2292 => 1.2757, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.57% (1.0594 => 1.0972, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.56% (0.3453 => 0.3576, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.4563 => 1.5064, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.35% (1.1364 => 1.1745, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.4016 => 0.4150, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.31% (16.6129 => 17.1634, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 3.30% (3.8646 => 3.9923, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5577 => 0.5760, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.2193 => 1.2591, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3868 => 0.3994, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4390 => 0.4533, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.23% (1.1061 => 1.1418, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9878, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.11% (2.1791 => 2.2469, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.7460 => 0.7689, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (13.2842 => 13.6904, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 3.06% (0.3534 => 0.3642, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.9865 => 5.1304, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.86% (1.3819 => 1.4214, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (1.3813 => 1.4202, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.80% (0.7506 => 0.7716, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.68% (7.2180 => 7.4116, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 2.65% (0.4003 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.63% (0.3914 => 0.4017, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7596, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2155, std. dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7148, std. dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.05% (4.4433 => 4.5344, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (4.3801 => 4.4628, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2452, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.8698 => 0.8833, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.44% (14.5298 => 14.7384, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4927, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.2785 => 6.3429, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 8.40% (1.2998 => 1.4090, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7339, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9188, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5178, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.96% (7.9275 => 8.1618, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5862, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.5928 => 4.7125, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.34% (1.4298 => 1.4489, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.52% (0.4657 => 0.3981, std. dev.: 0.0231) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9734, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6041, std. dev.: 0.0138) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1092, std. dev.: 0.0126) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9017, std. dev.: 0.0540) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9695, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7045, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2509, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2343, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2478, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (9.9194 => 9.8198, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 22:05:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 00:05:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622050552.57A542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1364?compare_to=1361&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1364, Order: 158961, Start Time: 2012-06-22 04:06:28, End Time: 2012-06-22 05:07:20 To: 1361, Order: 158957, Start Time: 2012-06-22 02:38:33, End Time: 2012-06-22 03:39:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 1 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (824 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.43% (11.1397 => 10.8691, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.01% (0.3497 => 0.3707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3543 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3561 => 0.3770, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 5.83% (0.3516 => 0.3721, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3543 => 0.3749, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 5.63% (0.3694 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.56% (0.3828 => 0.4041, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.55% (0.3927 => 0.4145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.43% (0.3886 => 0.4097, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.84% (10.3673 => 10.8691, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.7433 => 0.7681, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (7.0540 => 7.2429, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 2.48% (0.5925 => 0.6072, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.38% (0.4615 => 0.4725, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.21% (0.8172 => 0.8353, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 2.18% (0.7326 => 0.7486, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.91% (21.9371 => 22.3565, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (4.2646 => 4.3425, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.66% (10.4361 => 10.6098, std. dev.: 0.0108) MultiSource/Applications/Burg/burg: 1.64% (1.1642 => 1.1833, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.63% (3.3354 => 3.3899, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.9449 => 5.0246, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.56% (2.0273 => 2.0589, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 1.54% (5.7591 => 5.8477, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.54% (0.8067 => 0.8191, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (5.0018 => 5.0777, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.48% (3.8723 => 3.9296, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.4186 => 1.4384, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.36% (1.1861 => 1.2022, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (2.2022 => 2.2305, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.1363 => 8.2405, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5610, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (7.9617 => 8.0541, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 1.11% (2.2969 => 2.3223, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (9.4845 => 9.5885, std. dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (14.3668 => 14.5216, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7818, std. dev.: 0.0366) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.36% (0.8651 => 0.7236, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.41% (5.2763 => 4.7798, std. dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (2.9384 => 2.6978, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0476, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3010, std. dev.: 0.0415) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (6.6874 => 6.3965, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -2.83% (22.1758 => 21.5479, std. dev.: 0.0233) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7411, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 22:48:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 00:48:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622054845.2B7462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1365?compare_to=1363&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1365, Order: 158963, Start Time: 2012-06-22 04:53:26, End Time: 2012-06-22 05:50:14 To: 1363, Order: 158960, Start Time: 2012-06-22 03:29:49, End Time: 2012-06-22 04:26:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.21% (2.0176 => 2.2841, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.88% (0.5818 => 0.6160, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5748 => 0.6064, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.7710 => 0.8131, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 5.35% (1.3693 => 1.4426, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.20% (0.4328 => 0.4553, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.18% (0.7061 => 0.7427, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (3.9660 => 4.1612, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5265 => 0.5515, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.65% (0.4062 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.6959 => 0.7280, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 4.59% (0.2726 => 0.2851, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.39% (0.2782 => 0.2904, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.33% (0.2607 => 0.2720, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.31% (1.9828 => 2.0682, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.29% (0.2655 => 0.2769, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.18% (1.3245 => 1.3798, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3489 => 0.3634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9199 => 0.9581, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.09% (13.8202 => 14.3848, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.90% (0.3485 => 0.3621, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.59% (0.3534 => 0.3661, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.59% (1.0594 => 1.0974, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.54% (3.8646 => 4.0016, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.53% (16.6129 => 17.1993, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.45% (2.1791 => 2.2543, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5062, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.42% (0.5637 => 0.5830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5577 => 0.5767, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.39% (1.1061 => 1.1436, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1364 => 1.1744, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.32% (1.9270 => 1.9910, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.2193 => 1.2590, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 3.13% (0.3578 => 0.3690, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.12% (0.3914 => 0.4036, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (13.2842 => 13.6875, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 3.00% (0.3601 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.99% (0.3646 => 0.3755, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.98% (0.7460 => 0.7682, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 2.92% (0.3663 => 0.3770, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.92% (1.3813 => 1.4216, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 2.89% (0.3940 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.85% (0.3650 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.84% (0.7506 => 0.7719, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4193, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.55% (7.2180 => 7.4024, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.54% (3.6692 => 3.7623, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.47% (4.9865 => 5.1097, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2129, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4379 => 0.4479, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.5754 => 6.7187, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1333 => 1.1567, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (4.3801 => 4.4632, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2490, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5242, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.8698 => 0.8851, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.5298 => 14.7527, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4784, std. dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.18% (8.4961 => 8.5961, std. dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (6.2785 => 6.3495, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.23% (2.0200 => 2.1863, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 6.84% (1.2998 => 1.3887, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7220, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (12.4560 => 12.9281, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5841, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.5928 => 4.7142, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1200, std. dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5184 => 0.5302, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.61% (0.4657 => 0.4023, std. dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0013, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5764, std. dev.: 0.0165) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0962, std. dev.: 0.0188) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.03% (3.0263 => 2.9649, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7063, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9709, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.62% (0.8342 => 0.8207, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2579, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2353, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2485, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8704, std. dev.: 0.0173) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (9.9194 => 9.8193, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 23:33:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 01:33:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622063340.51C102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1366?compare_to=1364&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1366, Order: 158963, Start Time: 2012-06-22 05:34:18, End Time: 2012-06-22 06:35:10 To: 1364, Order: 158961, Start Time: 2012-06-22 04:06:28, End Time: 2012-06-22 05:07:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (40 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (10.8691 => 11.2136, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.16% (10.3673 => 11.2136, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3473 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.80% (0.3516 => 0.3755, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3561 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3543 => 0.3781, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.69% (0.3543 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.28% (0.3886 => 0.4130, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.8172 => 0.8441, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 2.97% (0.7433 => 0.7654, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 2.90% (0.5925 => 0.6097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.79% (0.6030 => 0.6198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7326 => 0.7521, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4615 => 0.4730, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (7.0540 => 7.2205, std. dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 1.92% (21.9371 => 22.3576, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.84% (4.2646 => 4.3431, std. dev.: 0.0110) MultiSource/Applications/spiff/spiff: 1.74% (0.7835 => 0.7971, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.60% (2.0273 => 2.0598, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.59% (0.8067 => 0.8195, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (5.0018 => 5.0807, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (10.4361 => 10.6007, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.4186 => 1.4403, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.52% (1.5415 => 1.5649, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (4.9449 => 5.0184, std. dev.: 0.0114) MultiSource/Applications/d/make_dparser: 1.45% (3.3354 => 3.3836, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 1.42% (1.1642 => 1.1807, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.1363 => 8.2503, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1861 => 1.2023, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9248, std. dev.: 0.0144) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.35% (7.9617 => 8.0690, std. dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 1.29% (5.7591 => 5.8334, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (9.4845 => 9.6014, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.11% (14.3668 => 14.5259, std. dev.: 0.0128) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (2.2022 => 2.2256, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.03% (2.2969 => 2.3206, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.47% (26.0924 => 26.7359, std. dev.: 0.0392) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.09% (0.8651 => 0.7259, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.29% (5.2763 => 4.7861, std. dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (2.9384 => 2.6993, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.47% (1.1194 => 1.0470, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3422, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.25% (6.6874 => 6.4033, std. dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: -2.72% (22.1758 => 21.5720, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 21 23:44:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 01:44:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622064428.BC42E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1367?compare_to=1362&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1367, Order: 158961, Start Time: 2012-06-22 04:30:37, End Time: 2012-06-22 06:45:58 To: 1362, Order: 158956, Start Time: 2012-06-22 01:48:24, End Time: 2012-06-22 04:03:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.29% (0.3792 => 0.4258, std. dev.: 0.0180) SingleSource/UnitTests/ObjC/trivial-interface: 7.70% (0.3442 => 0.3707, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.57% (0.3446 => 0.3707, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.56% (0.3465 => 0.3727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3460 => 0.3721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3488 => 0.3750, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.47% (0.3469 => 0.3728, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 7.38% (0.3496 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3643 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3724 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.79% (0.5826 => 0.6047, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.57% (0.5889 => 0.6099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.17% (0.7171 => 0.7398, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.85% (1.6211 => 1.6673, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.48% (3.5627 => 3.6510, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.5900 => 0.6041, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (0.5026 => 0.5138, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (0.4994 => 0.5096, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (1.3152 => 1.3417, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.91% (4.2109 => 4.2915, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (2.0673 => 2.1022, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.66% (0.9909 => 1.0073, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.48% (1.5932 => 1.6168, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (1.9694 => 1.9953, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.29% (23.5202 => 23.8237, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (1.9966 => 2.0210, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (4.4195 => 4.4720, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.62% (11.9555 => 11.6426, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.32% (2.4764 => 2.4190, std. dev.: 0.0050) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 00:15:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 02:15:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622071522.AAA742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1368?compare_to=1365&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1368, Order: 158974, Start Time: 2012-06-22 06:17:07, End Time: 2012-06-22 07:16:49 To: 1365, Order: 158963, Start Time: 2012-06-22 04:53:26, End Time: 2012-06-22 05:50:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (758 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2846, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.03% (0.7710 => 0.8175, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.5818 => 0.6158, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (3.9660 => 4.1905, std. dev.: 0.0100) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5748 => 0.6070, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.39% (0.1986 => 0.2093, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (0.4328 => 0.4557, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7061 => 0.7430, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.77% (0.5265 => 0.5516, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.4062 => 0.4254, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.57% (0.6959 => 0.7277, std. dev.: 0.0072) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.45% (0.2607 => 0.2723, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2782 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3489 => 0.3640, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.28% (1.9828 => 2.0677, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.3245 => 1.3809, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (0.9199 => 0.9584, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (1.4563 => 1.5152, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2696 => 0.2804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.91% (0.3453 => 0.3588, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4016 => 0.4163, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.61% (0.2988 => 0.3096, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.60% (1.0594 => 1.0975, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (3.8646 => 3.9975, std. dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1364 => 1.1744, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.30% (0.5577 => 0.5761, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.29% (1.2193 => 1.2594, std. dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.3914 => 0.4042, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.21% (0.3578 => 0.3693, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (13.2842 => 13.7037, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 3.02% (0.3646 => 0.3756, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.01% (0.3650 => 0.3760, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.00% (0.3601 => 0.3709, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.7460 => 0.7683, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4230, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/property: 2.87% (0.3940 => 0.4053, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.83% (1.3813 => 1.4204, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (3.6692 => 3.7677, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.50% (7.2180 => 7.3986, std. dev.: 0.0456) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.44% (0.4379 => 0.4486, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.3801 => 4.4678, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5241, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2656, std. dev.: 0.0509) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (0.2093 => 0.2200, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7262, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.53% (12.0921 => 12.5184, std. dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.97% (7.9275 => 8.1627, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.73% (4.5928 => 4.7180, std. dev.: 0.0409) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.5184 => 0.5300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1921, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9555, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1938, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9559, std. dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.47% (0.3511 => 0.3389, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5812, std. dev.: 0.0268) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9536, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.87% (3.0263 => 2.9696, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7043, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2398, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4876, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2468, std. dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2362, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (9.9194 => 9.8199, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 01:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 03:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622080433.0BA2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1369?compare_to=1366&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1369, Order: 158978, Start Time: 2012-06-22 07:03:19, End Time: 2012-06-22 08:06:02 To: 1366, Order: 158963, Start Time: 2012-06-22 05:34:18, End Time: 2012-06-22 06:35:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (7 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.11% (10.3673 => 11.2077, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/trivial-interface: 6.94% (0.3473 => 0.3714, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3561 => 0.3805, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.80% (0.3543 => 0.3784, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3497 => 0.3734, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3543 => 0.3782, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3694 => 0.3936, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 6.43% (0.3828 => 0.4074, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/property: 6.36% (0.3886 => 0.4133, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.03% (0.8172 => 0.8501, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 3.11% (0.7433 => 0.7664, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4615 => 0.4734, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (7.0540 => 7.2301, std. dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.07% (0.5569 => 0.5684, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.94% (21.9371 => 22.3635, std. dev.: 0.0341) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (4.2646 => 4.3468, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.88% (1.1642 => 1.1861, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.75% (0.7835 => 0.7972, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 1.71% (2.0273 => 2.0619, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.5415 => 1.5674, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (4.9449 => 5.0277, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (7.9617 => 8.0949, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (10.4361 => 10.6046, std. dev.: 0.0190) MultiSource/Applications/d/make_dparser: 1.60% (3.3354 => 3.3889, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (5.0018 => 5.0816, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.4186 => 1.4404, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1861 => 1.2038, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.48% (3.8723 => 3.9296, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (8.1363 => 8.2535, std. dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6190, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (0.8101 => 0.8206, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.28% (5.7591 => 5.8328, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.15% (0.9765 => 0.9877, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (14.3668 => 14.5311, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.12% (2.2969 => 2.3226, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (2.2022 => 2.2256, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.47% (26.0924 => 26.7364, std. dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.74% (1.3045 => 1.3272, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.13% (0.8651 => 0.7256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.24% (5.2763 => 4.7887, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.12% (2.9384 => 2.6998, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0477, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.13% (6.6874 => 6.4110, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: -2.84% (22.1758 => 21.5452, std. dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 01:39:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 03:39:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622083929.EFD2F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1370?compare_to=1368&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1370, Order: 158978, Start Time: 2012-06-22 07:43:59, End Time: 2012-06-22 08:40:58 To: 1368, Order: 158974, Start Time: 2012-06-22 06:17:07, End Time: 2012-06-22 07:16:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.20% (2.0176 => 2.2840, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.5818 => 0.6161, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.60% (0.7038 => 0.7432, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.58% (0.5748 => 0.6069, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.30% (1.3693 => 1.4419, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.29% (3.9660 => 4.1759, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (0.4328 => 0.4557, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.7710 => 0.8116, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7061 => 0.7430, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4062 => 0.4262, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.5265 => 0.5519, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2782 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.45% (0.2607 => 0.2723, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (1.9828 => 2.0690, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3489 => 0.3637, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3580 => 0.3730, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.95% (0.9199 => 0.9562, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.90% (0.3485 => 0.3621, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3562, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3534 => 0.3666, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.70% (16.6129 => 17.2269, std. dev.: 0.0131) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0977, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.8646 => 3.9983, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (0.4390 => 0.4541, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.5637 => 0.5829, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5059, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 3.38% (1.1061 => 1.1435, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.37% (1.9270 => 1.9919, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.33% (2.1791 => 2.2517, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.2193 => 1.2595, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.25% (0.5577 => 0.5758, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1364 => 1.1727, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.14% (0.3914 => 0.4037, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.7460 => 0.7689, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 3.03% (0.3601 => 0.3710, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.02% (0.3646 => 0.3756, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (13.2842 => 13.6783, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 2.87% (0.3940 => 0.4053, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.87% (1.3813 => 1.4209, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.59% (1.3819 => 1.4177, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.56% (3.6692 => 3.7631, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (4.9865 => 5.1109, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (7.2180 => 7.3953, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2149, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.33% (0.4379 => 0.4481, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.5754 => 6.7188, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1333 => 1.1567, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4657, std. dev.: 0.0120) MultiSource/Applications/d/make_dparser: 1.89% (3.1889 => 3.2493, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7876, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (4.4433 => 4.5218, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.8698 => 0.8845, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4732, std. dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2749 => 1.2915, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0328) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1887, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.97% (1.2998 => 1.4034, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7223, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5170, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5850, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.65% (4.5928 => 4.7147, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1317, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (0.5184 => 0.5299, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.70% (10.7476 => 10.9305, std. dev.: 0.0231) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9630, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.47% (0.3511 => 0.3389, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5912, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -2.56% (9.3358 => 9.0968, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9139, std. dev.: 0.0750) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4965, std. dev.: 0.0070) MultiSource/Applications/spiff/spiff: -1.98% (3.0263 => 2.9665, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7084, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2461, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2312, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2466, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.00% (9.9194 => 9.8198, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 02:31:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 04:31:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622093156.029252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1371?compare_to=1367&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1371, Order: 158978, Start Time: 2012-06-22 07:18:01, End Time: 2012-06-22 09:33:24 To: 1367, Order: 158961, Start Time: 2012-06-22 04:30:37, End Time: 2012-06-22 06:45:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (28 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 892 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.2262 => 0.2403, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (2.0660 => 2.1052, std. dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.76% (0.3446 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3442 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3465 => 0.3698, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.68% (0.3488 => 0.3721, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3460 => 0.3691, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3469 => 0.3698, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3496 => 0.3726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.45% (0.3643 => 0.3878, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.25% (0.3650 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.15% (0.3724 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5826 => 0.6015, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.99% (0.5889 => 0.6065, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (1.6211 => 1.6646, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (3.5627 => 3.6532, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.5900 => 0.6041, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.10% (1.3152 => 1.3428, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (0.5026 => 0.5131, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (0.4994 => 0.5096, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.86% (4.2109 => 4.2894, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 1.83% (0.7171 => 0.7302, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.43% (0.9909 => 1.0051, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.41% (2.0673 => 2.0965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.37% (1.9694 => 1.9964, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.31% (4.4195 => 4.4772, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 1.30% (1.0781 => 1.0921, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (1.9966 => 2.0217, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.10% (1.5932 => 1.6108, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (2.0820 => 2.1052, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.72% (11.9555 => 11.6303, std. dev.: 0.0106) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 02:32:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 04:32:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622093225.DC1C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1372?compare_to=1369&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1372, Order: 158979, Start Time: 2012-06-22 08:33:08, End Time: 2012-06-22 09:33:54 To: 1369, Order: 158978, Start Time: 2012-06-22 07:03:19, End Time: 2012-06-22 08:06:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (27 on baseline) Performance Improvements: 3 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (838 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.82% (19.6116 => 19.9690, std. dev.: 0.0266) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.16% (0.8501 => 0.8317, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.03% (1.4404 => 1.4256, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.56% (1.3272 => 1.3065, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.68% (10.3673 => 11.2672, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 6.31% (0.3473 => 0.3692, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.21% (0.3543 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.18% (0.3497 => 0.3713, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.15% (0.3561 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.12% (0.3543 => 0.3760, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.11% (0.3516 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.98% (0.3694 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3828 => 0.4048, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.74% (0.3886 => 0.4109, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.73% (0.3927 => 0.4152, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5925 => 0.6148, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.37% (0.6030 => 0.6233, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.88% (0.7326 => 0.7537, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (7.0540 => 7.2163, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (0.8172 => 0.8317, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 1.69% (21.9371 => 22.3086, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 1.59% (10.4361 => 10.6022, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.54% (4.2646 => 4.3303, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (2.2022 => 2.2348, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.9449 => 5.0079, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.5415 => 1.5607, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8265, std. dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (7.9617 => 8.0498, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.00% (5.0018 => 5.0520, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7498, std. dev.: 0.0200) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.61% (0.8651 => 0.7301, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7842, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (2.9384 => 2.6969, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0467, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4786, std. dev.: 0.0364) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.22% (6.6874 => 6.4052, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -3.08% (22.1758 => 21.4929, std. dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 03:03:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 05:03:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622100315.7A5FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1373?compare_to=1370&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1373, Order: 158980, Start Time: 2012-06-22 09:07:54, End Time: 2012-06-22 10:04:43 To: 1370, Order: 158978, Start Time: 2012-06-22 07:43:59, End Time: 2012-06-22 08:40:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.54% (0.4248 => 0.3970, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.25% (1.3800 => 1.3628, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.11% (10.9305 => 10.8096, std. dev.: 0.0267) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.04% (1.9670 => 1.9465, std. dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.46% (2.0176 => 2.2891, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 6.77% (0.5818 => 0.6212, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.44% (0.5748 => 0.6118, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7061 => 0.7473, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.36% (0.7038 => 0.7415, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4373, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (0.4328 => 0.4541, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.7710 => 0.8070, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1503, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4062 => 0.4241, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3022 => 0.3150, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.6959 => 0.7244, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2781 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2726 => 0.2832, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2966 => 0.3081, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.82% (0.3899 => 0.4048, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2765 => 0.2870, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2760 => 0.2864, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2655 => 0.2755, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (1.9828 => 2.0568, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2761 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.72% (0.2690 => 0.2790, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2292 => 1.2747, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.69% (13.8202 => 14.3308, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.2937 => 0.3045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.60% (0.3107 => 0.3219, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3149 => 0.3262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.47% (0.3578 => 0.3702, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3453 => 0.3570, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.35% (0.3914 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9199 => 0.9505, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 3.32% (0.4003 => 0.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.27% (0.3789 => 0.3913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4016 => 0.4147, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.19% (0.3601 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.18% (0.3646 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.15% (0.3650 => 0.3765, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3293 => 0.3396, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.4563 => 1.5013, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3756 => 0.3872, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.05% (0.4390 => 0.4524, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 3.04% (0.3623 => 0.3733, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.97% (0.3868 => 0.3983, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1059, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: 2.94% (0.3534 => 0.3638, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5577 => 0.5741, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.1364 => 1.1697, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (3.8646 => 3.9770, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.72% (1.1061 => 1.1362, std. dev.: 0.0065) MultiSource/Applications/treecc/treecc: 2.63% (1.9270 => 1.9777, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.2842 => 13.6258, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (4.9865 => 5.1109, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (1.3813 => 1.4153, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: 2.44% (0.7506 => 0.7689, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.35% (1.3819 => 1.4144, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.27% (3.6692 => 3.7526, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (7.2180 => 7.3804, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2278, std. dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 2.17% (14.8535 => 15.1754, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.5754 => 6.6971, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4529, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.49% (4.4433 => 4.5093, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2344, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1333 => 1.1476, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3075, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2759, std. dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.64% (2.0200 => 2.1946, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4114, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7289, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5168, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5853, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.77% (7.9275 => 8.1471, std. dev.: 0.0166) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.5928 => 4.7156, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.5184 => 0.5303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0083) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 1.28% (1.2308 => 1.2466, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.75% (0.4657 => 0.3970, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9721, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3511 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5862, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1006, std. dev.: 0.0598) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9221, std. dev.: 0.0304) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9641, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7055, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.5254 => 2.4868, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2306, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2476, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (9.9194 => 9.8196, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 04:00:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 06:00:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622110025.D43A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1374?compare_to=1372&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1374, Order: 158981, Start Time: 2012-06-22 10:01:04, End Time: 2012-06-22 11:01:55 To: 1372, Order: 158979, Start Time: 2012-06-22 08:33:08, End Time: 2012-06-22 09:33:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (25 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (840 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (1.3065 => 1.3208, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.72% (10.3673 => 11.2713, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/trivial-interface: 6.33% (0.3473 => 0.3693, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.23% (0.3497 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.18% (0.3543 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3543 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3561 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.11% (0.3516 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.82% (0.3694 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.78% (0.3927 => 0.4154, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3828 => 0.4048, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.61% (0.3886 => 0.4104, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.71% (0.5925 => 0.6145, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.32% (0.6030 => 0.6230, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7326 => 0.7539, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (7.0540 => 7.2295, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.68% (21.9371 => 22.3064, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (10.4361 => 10.6011, std. dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.2646 => 4.3267, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (2.2022 => 2.2337, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8273, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.9449 => 5.0002, std. dev.: 0.0163) MultiSource/Applications/treecc/treecc: 1.06% (2.0273 => 2.0487, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7423, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (1.3045 => 1.3208, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.77% (0.8651 => 0.7287, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.34% (5.2763 => 4.7837, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (2.9384 => 2.6940, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.43% (1.1194 => 1.0474, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4460, std. dev.: 0.0230) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.19% (6.6874 => 6.4072, std. dev.: 0.0215) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4880, std. dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 04:26:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 06:26:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622112652.7A5542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1375?compare_to=1373&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1375, Order: 158981, Start Time: 2012-06-22 10:31:37, End Time: 2012-06-22 11:28:22 To: 1373, Order: 158980, Start Time: 2012-06-22 09:07:54, End Time: 2012-06-22 10:04:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.5818 => 0.6208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5748 => 0.6116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7061 => 0.7485, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 5.40% (0.7038 => 0.7418, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.02% (1.3693 => 1.4380, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1521, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.7710 => 0.8055, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4062 => 0.4241, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.27% (0.5265 => 0.5490, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.20% (0.3022 => 0.3149, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.03% (0.2781 => 0.2893, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.3489 => 0.3629, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.01% (0.6959 => 0.7238, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.95% (0.2782 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2966 => 0.3081, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.84% (0.2655 => 0.2757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.84% (0.2607 => 0.2707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2765 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.79% (0.2690 => 0.2792, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2761 => 0.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (1.9828 => 2.0569, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2750, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.70% (13.8202 => 14.3314, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ary: 3.64% (0.3107 => 0.3220, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.58% (0.2937 => 0.3042, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3149 => 0.3261, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 3.42% (0.3914 => 0.4048, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.41% (0.4016 => 0.4153, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3453 => 0.3570, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.37% (0.4003 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.35% (0.3578 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 3.27% (0.3789 => 0.3913, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.23% (0.4390 => 0.4532, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.19% (0.3601 => 0.3716, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3756 => 0.3875, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.4563 => 1.5019, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 3.11% (0.3663 => 0.3777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.07% (0.3650 => 0.3762, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.06% (0.3534 => 0.3642, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1183, std. dev.: 0.0147) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-3: 2.98% (0.3623 => 0.3731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.95% (0.3868 => 0.3982, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.1364 => 1.1698, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8646 => 3.9752, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.82% (1.1061 => 1.1373, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.71% (1.9270 => 1.9793, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.68% (0.7460 => 0.7660, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1121, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 2.50% (0.7506 => 0.7694, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.48% (1.3819 => 1.4162, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (13.2842 => 13.6041, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4145, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2301, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.28% (3.6692 => 3.7529, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.21% (14.8535 => 15.1817, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (7.2180 => 7.3707, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (6.5754 => 6.6978, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.8698 => 0.8843, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.3801 => 4.4512, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (4.4433 => 4.5100, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.46% (3.1889 => 3.2356, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3073, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2513, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.15% (2.0200 => 2.1846, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3998, std. dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7264, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9225, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.51% (12.0921 => 12.5171, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.38% (1.7688 => 1.8286, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5859, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.68% (4.5928 => 4.7158, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1270, std. dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.5184 => 0.5307, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9541, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.17% (1.2308 => 1.2452, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std. dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9873, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.79% (0.3511 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.30% (0.9108 => 0.8990, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5960, std. dev.: 0.0170) MultiSource/Applications/minisat/minisat: -2.58% (9.3358 => 9.0948, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -1.94% (3.0263 => 2.9677, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9609, std. dev.: 0.0624) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7046, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2303, std. dev.: 0.0236) MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (5.3167 => 5.2442, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 05:14:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 07:14:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622121427.848D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1376?compare_to=1371&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1376, Order: 158981, Start Time: 2012-06-22 10:00:17, End Time: 2012-06-22 12:15:57 To: 1371, Order: 158978, Start Time: 2012-06-22 07:18:01, End Time: 2012-06-22 09:33:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (30 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 889 (863 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 2.00% (0.7302 => 0.7448, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 1.76% (0.6015 => 0.6121, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.68% (0.6065 => 0.6167, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.27% (17.1416 => 17.3599, std. dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.30% (2.1052 => 2.0568, std. dev.: 0.0177) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3446 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.17% (0.3460 => 0.3708, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3496 => 0.3746, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3465 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.09% (0.3442 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.08% (0.3488 => 0.3735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.06% (0.3469 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.70% (0.3643 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.66% (0.3650 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.50% (0.3724 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5826 => 0.6121, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.72% (0.5889 => 0.6167, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.86% (0.7171 => 0.7448, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (0.5026 => 0.5171, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (1.6211 => 1.6663, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (3.5627 => 3.6528, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.22% (0.4994 => 0.5105, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.08% (1.5932 => 1.6263, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.01% (4.2109 => 4.2954, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (1.3152 => 1.3414, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0673 => 2.1055, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.82% (0.9909 => 1.0089, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.55% (1.0781 => 1.0948, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (1.9694 => 1.9969, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.35% (23.5202 => 23.8388, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.33% (4.4195 => 4.4785, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (1.9966 => 2.0225, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.24% (0.9697 => 0.9817, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.34% (11.9555 => 11.6752, std. dev.: 0.0104) Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 05:28:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 07:28:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622122806.AE58B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1377?compare_to=1374&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1377, Order: 158986, Start Time: 2012-06-22 11:28:47, End Time: 2012-06-22 12:29:37 To: 1374, Order: 158981, Start Time: 2012-06-22 10:01:04, End Time: 2012-06-22 11:01:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (37 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.8304 => 0.8452, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.11% (10.3673 => 11.2078, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 6.94% (0.3473 => 0.3714, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3543 => 0.3784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3561 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.75% (0.3543 => 0.3782, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3516 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3694 => 0.3932, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.43% (0.3828 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.29% (0.3927 => 0.4174, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.15% (0.3886 => 0.4125, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.43% (0.8172 => 0.8452, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.93% (0.7433 => 0.7651, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.82% (0.5925 => 0.6092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.75% (0.6030 => 0.6196, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (7.0540 => 7.2251, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 2.09% (0.7326 => 0.7479, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.94% (0.5569 => 0.5677, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.82% (4.2646 => 4.3424, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.81% (21.9371 => 22.3343, std. dev.: 0.0152) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (10.4361 => 10.6039, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.60% (0.8067 => 0.8196, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.58% (0.7835 => 0.7959, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 1.56% (1.1642 => 1.1824, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.55% (2.0273 => 2.0587, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.9449 => 5.0203, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.5415 => 1.5645, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (5.0018 => 5.0740, std. dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (7.9617 => 8.0751, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.39% (8.1363 => 8.2496, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.39% (3.8723 => 3.9261, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.38% (3.3354 => 3.3815, std. dev.: 0.0164) MultiSource/Applications/oggenc/oggenc: 1.32% (5.7591 => 5.8349, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (9.4845 => 9.5920, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (2.2022 => 2.2269, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (14.3668 => 14.5213, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7755, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.38% (0.8651 => 0.7234, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7869, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (2.9384 => 2.6970, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0467, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3010, std. dev.: 0.0829) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.21% (6.6874 => 6.4057, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -2.75% (22.1758 => 21.5650, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 05:50:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 07:50:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622125035.4674D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1378?compare_to=1375&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1378, Order: 158989, Start Time: 2012-06-22 11:55:18, End Time: 2012-06-22 12:52:04 To: 1375, Order: 158981, Start Time: 2012-06-22 10:31:37, End Time: 2012-06-22 11:28:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.20% (1.3643 => 1.3807, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.18% (2.2301 => 2.2564, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2845, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.5818 => 0.6168, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.56% (0.7038 => 0.7429, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 5.55% (0.5748 => 0.6067, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.7710 => 0.8131, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.25% (1.3693 => 1.4412, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7061 => 0.7426, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5265 => 0.5525, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (3.9660 => 4.1591, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.68% (0.4062 => 0.4252, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.63% (0.3022 => 0.3162, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.63% (0.6959 => 0.7281, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.37% (0.2607 => 0.2721, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.33% (1.9828 => 2.0686, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2761 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2696 => 0.2804, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3485 => 0.3623, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.93% (13.8202 => 14.3636, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/sieve: 3.91% (0.3453 => 0.3588, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3756 => 0.3898, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 3.70% (16.6129 => 17.2284, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4016 => 0.4163, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.60% (1.0594 => 1.0975, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2564, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5066, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (3.8646 => 3.9980, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.40% (1.9270 => 1.9925, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5577 => 0.5766, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.37% (1.1061 => 1.1434, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (1.1364 => 1.1742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5637 => 0.5824, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.2193 => 1.2589, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.25% (0.3789 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.16% (0.3578 => 0.3691, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.14% (0.3914 => 0.4037, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 3.13% (0.3646 => 0.3760, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.03% (0.3601 => 0.3710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (13.2842 => 13.6842, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.94% (0.7506 => 0.7727, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.88% (0.3650 => 0.3755, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.79% (1.3813 => 1.4199, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4194, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.56% (4.9865 => 5.1142, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (3.6692 => 3.7598, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.45% (7.2180 => 7.3945, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2141, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4379 => 0.4483, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.5754 => 6.7175, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1333 => 1.1566, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.3801 => 4.4684, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2488, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (4.4433 => 4.5226, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.8698 => 0.8843, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.51% (14.5298 => 14.7486, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4720, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3420, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2727, std. dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7330, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5174, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5854, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1487, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.74% (4.5928 => 4.7187, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 1.38% (1.2308 => 1.2478, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.06% (22.5627 => 20.9689, std. dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3511 => 0.3390, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.39% (0.9108 => 0.8981, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0139) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -2.54% (0.4533 => 0.4418, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1102, std. dev.: 0.0126) MultiSource/Applications/spiff/spiff: -2.02% (3.0263 => 2.9652, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7060, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5119, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9977, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2504, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.62% (0.8342 => 0.8207, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8590, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2461, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2360, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (9.9194 => 9.8189, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 06:56:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 08:56:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622135602.7955B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1379?compare_to=1377&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1379, Order: 158989, Start Time: 2012-06-22 12:56:32, End Time: 2012-06-22 13:57:30 To: 1377, Order: 158986, Start Time: 2012-06-22 11:28:47, End Time: 2012-06-22 12:29:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (824 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.10% (10.3673 => 11.2074, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3473 => 0.3713, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.74% (0.3561 => 0.3801, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3516 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.69% (0.3543 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3543 => 0.3779, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3694 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 6.26% (0.3927 => 0.4173, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.8172 => 0.8443, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7433 => 0.7659, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.77% (0.6030 => 0.6197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.77% (0.5925 => 0.6089, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4615 => 0.4734, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (7.0540 => 7.2220, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7326 => 0.7478, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.90% (0.8067 => 0.8220, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3453, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.89% (0.5569 => 0.5674, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.87% (21.9371 => 22.3475, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: 1.76% (0.7835 => 0.7973, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.74% (2.0273 => 2.0626, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (10.4361 => 10.5982, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.4186 => 1.4404, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.52% (1.1642 => 1.1819, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.9449 => 5.0194, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.46% (1.5415 => 1.5640, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2530, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.43% (3.3354 => 3.3830, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1861 => 1.2028, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (5.0018 => 5.0716, std. dev.: 0.0091) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9248, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (7.9617 => 8.0656, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8320, std. dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (9.4845 => 9.5951, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 1.11% (2.2969 => 2.3225, std. dev.: 0.0099) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.10% (2.2022 => 2.2264, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (14.3668 => 14.5172, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7602, std. dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.37% (0.8651 => 0.7235, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7839, std. dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.18% (2.9384 => 2.6981, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.34% (1.1194 => 1.0484, std. dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3106, std. dev.: 0.0378) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.26% (6.6874 => 6.4027, std. dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: -2.82% (22.1758 => 21.5502, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 07:56:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 09:56:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622145620.D41E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1380?compare_to=1378&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1380, Order: 158992, Start Time: 2012-06-22 14:01:00, End Time: 2012-06-22 14:57:50 To: 1378, Order: 158989, Start Time: 2012-06-22 11:55:18, End Time: 2012-06-22 12:52:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.16% (5.5032 => 5.5669, std. dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2853, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.53% (0.5818 => 0.6140, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.48% (0.7038 => 0.7424, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5748 => 0.6051, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.13% (0.4328 => 0.4550, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1986 => 0.2086, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.7710 => 0.8095, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4373, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1576, std. dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7061 => 0.7401, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.55% (0.4062 => 0.4247, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.6959 => 0.7275, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3022 => 0.3155, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.32% (0.2966 => 0.3094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3149 => 0.3282, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2782 => 0.2899, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3580 => 0.3728, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3245 => 1.3792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.09% (0.2690 => 0.2800, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.09% (0.2937 => 0.3057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.07% (0.2655 => 0.2763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2765 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.9828 => 2.0623, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3485 => 0.3619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9199 => 0.9552, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.83% (13.8202 => 14.3498, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2292 => 1.2757, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.60% (0.3192 => 0.3307, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.56% (1.0594 => 1.0971, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 3.53% (3.8646 => 4.0011, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (0.3756 => 0.3887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.48% (0.2988 => 0.3092, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.46% (16.6129 => 17.1871, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.4016 => 0.4154, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.42% (2.1791 => 2.2537, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5049, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.33% (1.9270 => 1.9911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.31% (0.3293 => 0.3402, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.27% (1.1061 => 1.1423, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.22% (1.2193 => 1.2586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.19% (0.5577 => 0.5755, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1719, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 3.00% (0.4003 => 0.4123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.96% (0.3914 => 0.4030, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 2.93% (0.3578 => 0.3683, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (13.2842 => 13.6700, std. dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.7460 => 0.7676, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 2.85% (0.3789 => 0.3897, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.84% (0.7506 => 0.7719, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3646 => 0.3747, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 2.77% (0.3940 => 0.4049, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 2.73% (0.3663 => 0.3763, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4171, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.3813 => 1.4160, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.43% (4.9865 => 5.1077, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (3.6692 => 3.7564, std. dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: 2.32% (14.8535 => 15.1978, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (7.2180 => 7.3851, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.05% (6.5754 => 6.7104, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1550, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.3801 => 4.4607, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.8698 => 0.8853, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2445, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5181, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.48% (14.5298 => 14.7444, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1226, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.01% (16.2614 => 16.4260, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.86% (1.8175 => 2.2694, std. dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1872, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (1.5824 => 1.7003, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 7.26% (1.2998 => 1.3942, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7205, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0921 => 12.5153, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.93% (7.9275 => 8.1596, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.87% (11.2619 => 11.5847, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.69% (4.5928 => 4.7164, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.5184 => 0.5308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5108, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9388, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.34% (8.8259 => 8.6195, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1451, std. dev.: 0.0214) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.93% (3.0263 => 2.9680, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9683, std. dev.: 0.0315) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7084, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4877, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2341, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (9.9194 => 9.8194, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 07:56:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 09:56:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622145634.453302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1381?compare_to=1376&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1381, Order: 158989, Start Time: 2012-06-22 12:42:41, End Time: 2012-06-22 14:58:04 To: 1376, Order: 158981, Start Time: 2012-06-22 10:00:17, End Time: 2012-06-22 12:15:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (28 on baseline) Performance Improvements: 4 (1 on baseline) Unchanged Tests: 890 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.75% (0.6121 => 0.6014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.69% (0.6167 => 0.6063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.7448 => 0.7348, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -1.11% (1.6263 => 1.6082, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 19.88% (0.3792 => 0.4546, std. dev.: 0.0217) SingleSource/UnitTests/ObjC/trivial-interface: 6.86% (0.3442 => 0.3678, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3488 => 0.3726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.76% (0.3446 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3465 => 0.3699, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3460 => 0.3692, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3469 => 0.3699, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3496 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.48% (0.3643 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.27% (0.3650 => 0.3879, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.12% (0.3724 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.23% (0.5826 => 0.6014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.95% (0.5889 => 0.6063, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (0.5026 => 0.5159, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (1.6211 => 1.6639, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.47% (0.7171 => 0.7348, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (3.5627 => 3.6491, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.5900 => 0.6035, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.22% (1.3152 => 1.3444, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (0.4994 => 0.5099, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.86% (4.2109 => 4.2894, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (2.0673 => 2.0984, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 1.38% (0.9909 => 1.0046, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (1.9694 => 1.9955, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.29% (1.9966 => 2.0223, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.23% (1.0781 => 1.0914, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (4.4195 => 4.4727, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.2122 => 0.2270, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.86% (11.9555 => 11.6139, std. dev.: 0.0067) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 08:23:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 10:23:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622152349.E46D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1382?compare_to=1379&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1382, Order: 158994, Start Time: 2012-06-22 14:24:21, End Time: 2012-06-22 15:25:19 To: 1379, Order: 158989, Start Time: 2012-06-22 12:56:32, End Time: 2012-06-22 13:57:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (38 on baseline) Performance Improvements: 1 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (11.2074 => 11.0223, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.94% (0.3543 => 0.3789, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 6.45% (0.3473 => 0.3697, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 6.32% (10.3673 => 11.0223, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 6.29% (0.3497 => 0.3717, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.26% (0.3561 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.21% (0.3543 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.20% (0.3516 => 0.3734, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.98% (0.3694 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.88% (0.3828 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.76% (0.3927 => 0.4153, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.66% (0.3886 => 0.4106, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.7433 => 0.7652, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.62% (0.5925 => 0.6080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.49% (0.6030 => 0.6180, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (7.0540 => 7.2277, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.32% (0.4615 => 0.4722, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.8172 => 0.8361, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 1.84% (0.7326 => 0.7461, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (10.4361 => 10.6272, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.76% (21.9371 => 22.3233, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (4.2646 => 4.3369, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.62% (2.0273 => 2.0601, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.47% (0.7835 => 0.7950, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5629, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.38% (1.1642 => 1.1803, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.34% (2.2022 => 2.2317, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.9449 => 5.0102, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 1.32% (5.7591 => 5.8350, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.4186 => 1.4371, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1363 => 8.2424, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.30% (3.3354 => 3.3788, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (5.0018 => 5.0630, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1861 => 1.2006, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.22% (3.8723 => 3.9195, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (9.4845 => 9.5800, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (7.9617 => 8.0418, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7576, std. dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.92% (0.8651 => 0.7274, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.37% (5.2763 => 4.7817, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.26% (2.9384 => 2.6957, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.32% (1.1194 => 1.0486, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3649, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (6.6874 => 6.4205, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -2.79% (22.1758 => 21.5573, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.01% (1.7609 => 1.7432, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 09:19:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 11:19:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622161952.098C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1383?compare_to=1380&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1383, Order: 158994, Start Time: 2012-06-22 15:24:39, End Time: 2012-06-22 16:21:22 To: 1380, Order: 158992, Start Time: 2012-06-22 14:01:00, End Time: 2012-06-22 14:57:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.08% (5.5669 => 5.5068, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2836, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.55% (0.5818 => 0.6141, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7038 => 0.7425, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.36% (0.5748 => 0.6056, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.05% (1.3693 => 1.4384, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.7710 => 0.8095, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.90% (3.9660 => 4.1602, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7061 => 0.7400, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4062 => 0.4250, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.6959 => 0.7275, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3022 => 0.3155, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.2781 => 0.2903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.33% (0.3899 => 0.4068, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3489 => 0.3637, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3107 => 0.3235, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3785, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2760 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (1.9828 => 2.0630, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2655 => 0.2761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3485 => 0.3618, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.76% (1.2292 => 1.2754, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.75% (13.8202 => 14.3384, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.3756 => 0.3889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.51% (0.4016 => 0.4157, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.49% (16.6129 => 17.1923, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.5637 => 0.5829, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.37% (3.8646 => 3.9950, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.3868 => 0.3996, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3534 => 0.3650, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.27% (1.9270 => 1.9900, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.4563 => 1.5034, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.4390 => 0.4527, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2573, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1718, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.10% (0.3578 => 0.3689, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.10% (0.4003 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.96% (0.3914 => 0.4030, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (13.2842 => 13.6630, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.7460 => 0.7671, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 2.82% (0.3789 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.79% (0.3650 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3646 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 2.76% (0.3623 => 0.3723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 2.76% (0.3663 => 0.3764, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.73% (0.7506 => 0.7711, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 2.69% (0.3940 => 0.4046, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.54% (1.3813 => 1.4164, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (3.6692 => 3.7579, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.3819 => 1.4153, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (4.9865 => 5.1058, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2048, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (7.2180 => 7.3865, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (6.5754 => 6.7107, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1333 => 1.1551, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (4.3801 => 4.4571, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2437, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5165, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.8698 => 0.8841, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.34% (14.5298 => 14.7244, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2671, std. dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7376, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5181, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5845, std. dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1476, std. dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 2.71% (4.5928 => 4.7173, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5184 => 0.5304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std. dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9496, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0167) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0955, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9401, std. dev.: 0.0236) MultiSource/Applications/spiff/spiff: -1.89% (3.0263 => 2.9690, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7046, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.61% (0.8342 => 0.8208, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8693, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2426, std. dev.: 0.0203) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 09:51:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 11:51:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622165154.8080F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1384?compare_to=1382&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1384, Order: 158997, Start Time: 2012-06-22 15:52:19, End Time: 2012-06-22 16:53:23 To: 1382, Order: 158994, Start Time: 2012-06-22 14:24:21, End Time: 2012-06-22 15:25:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 1 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (835 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (11.0223 => 11.1410, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.12% (2.0762 => 2.0529, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.46% (10.3673 => 11.1410, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.73% (0.3543 => 0.3746, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 5.33% (0.3473 => 0.3658, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.06% (0.3497 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.05% (0.3543 => 0.3722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.03% (0.3516 => 0.3693, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.00% (0.3561 => 0.3739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 4.96% (0.3828 => 0.4018, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.86% (0.3927 => 0.4118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.79% (0.3694 => 0.3871, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 4.63% (0.3886 => 0.4066, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.23% (7.0540 => 7.2820, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 2.44% (0.6030 => 0.6177, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 2.32% (10.4361 => 10.6779, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.21% (0.4615 => 0.4717, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 2.01% (0.5925 => 0.6044, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.91% (2.2022 => 2.2443, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.76% (21.9371 => 22.3222, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.8172 => 0.8296, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.50% (4.2646 => 4.3285, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.29% (1.5415 => 1.5614, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8320, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (9.4845 => 9.5987, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.9449 => 5.0041, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3724, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (5.0018 => 5.0545, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 1.05% (2.0273 => 2.0486, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7802, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.23% (0.8651 => 0.7247, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7881, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.23% (2.9384 => 2.6966, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.54% (1.1194 => 1.0462, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5028, std. dev.: 0.0224) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.20% (6.6874 => 6.4068, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -3.02% (22.1758 => 21.5060, std. dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 10:38:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 12:38:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622173832.C16AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1385?compare_to=1381&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1385, Order: 158994, Start Time: 2012-06-22 15:24:46, End Time: 2012-06-22 17:40:02 To: 1381, Order: 158989, Start Time: 2012-06-22 12:42:41, End Time: 2012-06-22 14:58:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (28 on baseline) Performance Improvements: 2 (2 on baseline) Unchanged Tests: 891 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.76% (0.2264 => 0.2417, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.53% (0.4546 => 0.4022, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.2270 => 0.2167, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.70% (0.3446 => 0.3677, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3460 => 0.3690, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.64% (0.3496 => 0.3728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3465 => 0.3694, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3469 => 0.3698, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3442 => 0.3669, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.59% (0.3488 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.36% (0.3650 => 0.3882, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3643 => 0.3870, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.07% (0.3792 => 0.4022, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/parameter-passing: 5.99% (0.3724 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.28% (0.5826 => 0.6017, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 3.06% (0.5889 => 0.6069, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.77% (1.6211 => 1.6660, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (0.5026 => 0.5165, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7171 => 0.7353, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.47% (3.5627 => 3.6506, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (0.4994 => 0.5109, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (1.3152 => 1.3449, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.5900 => 0.6029, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.83% (4.2109 => 4.2881, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (2.0673 => 2.0963, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.39% (0.9909 => 1.0047, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (1.9694 => 1.9953, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (1.9966 => 2.0217, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.22% (1.0781 => 1.0913, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (4.4195 => 4.4720, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.14% (1.5932 => 1.6113, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.89% (11.9555 => 11.6100, std. dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -2.23% (2.4764 => 2.4213, std. dev.: 0.0199) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 10:43:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 12:43:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622174328.9DCBC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1386?compare_to=1383&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1386, Order: 159001, Start Time: 2012-06-22 16:48:18, End Time: 2012-06-22 17:44:58 To: 1383, Order: 158994, Start Time: 2012-06-22 15:24:39, End Time: 2012-06-22 16:21:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (756 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.42% (2.0176 => 2.2883, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.94% (0.5748 => 0.6032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4328 => 0.4539, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (3.9660 => 4.1572, std. dev.: 0.0083) MultiSource/Applications/hbd/hbd: 4.80% (1.3693 => 1.4350, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 4.79% (0.7061 => 0.7399, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 4.69% (0.5818 => 0.6091, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.7710 => 0.8052, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 4.28% (0.4062 => 0.4236, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.24% (0.6959 => 0.7254, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5265 => 0.5486, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3729, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.94% (0.3022 => 0.3141, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.85% (0.3580 => 0.3718, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.78% (0.2966 => 0.3078, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.77% (0.3899 => 0.4046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3489 => 0.3616, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.2781 => 0.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (0.3485 => 0.3610, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.2292 => 1.2722, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (1.9828 => 2.0519, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 3.48% (16.6129 => 17.1915, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3149 => 0.3249, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.4563 => 1.5024, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4016 => 0.4143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1432, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.09% (1.1364 => 1.1715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.3245 => 1.3654, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0594 => 1.0921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.04% (0.3453 => 0.3558, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9813, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.95% (1.2193 => 1.2553, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3756 => 0.3865, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.86% (1.9270 => 1.9821, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.86% (0.3534 => 0.3635, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.85% (1.1061 => 1.1376, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.82% (0.4390 => 0.4514, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.7460 => 0.7668, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.62% (2.1791 => 2.2363, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (1.3813 => 1.4174, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.44% (0.7506 => 0.7689, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.3819 => 1.4154, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6135 => 0.6281, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (3.6692 => 3.7564, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5956, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1960, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (7.2180 => 7.3721, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (6.5754 => 6.7090, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.8698 => 0.8856, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.3801 => 4.4543, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2422, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.4433 => 4.5141, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (1.2749 => 1.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1299, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (3.2742 => 3.3179, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (1.5188 => 1.5376, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.10% (14.5298 => 14.6897, std. dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (8.4961 => 8.5846, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.87% (1.8175 => 2.2877, std. dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.67% (2.0200 => 2.1952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7223, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.52% (12.0921 => 12.5179, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1564, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 2.86% (11.2619 => 11.5844, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.63% (4.5928 => 4.7135, std. dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5184 => 0.5306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.5627 => 21.0527, std. dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.58% (9.3358 => 9.0946, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6034, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9345, std. dev.: 0.0523) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9693, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7078, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2324, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2462, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (9.9194 => 9.8193, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 11:20:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 13:20:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622182035.5CCD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1387?compare_to=1384&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1387, Order: 159006, Start Time: 2012-06-22 17:21:14, End Time: 2012-06-22 18:22:06 To: 1384, Order: 158997, Start Time: 2012-06-22 15:52:19, End Time: 2012-06-22 16:53:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (37 on baseline) Performance Improvements: 1 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.60% (0.7416 => 0.7535, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (0.8296 => 0.8419, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (2.0529 => 2.0803, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4721 => 12.0923, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.55% (10.3673 => 11.1498, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.21% (0.3543 => 0.3763, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3473 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3516 => 0.3720, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 5.67% (0.3543 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.66% (0.3497 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.62% (0.3561 => 0.3761, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.47% (0.3694 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.36% (0.3828 => 0.4033, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.27% (0.3927 => 0.4134, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.12% (0.3886 => 0.4085, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (7.0540 => 7.3439, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 3.20% (0.6030 => 0.6223, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (0.7433 => 0.7663, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.8172 => 0.8419, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.99% (0.5925 => 0.6102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.85% (0.7326 => 0.7535, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (10.4361 => 10.7193, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.23% (21.9371 => 22.4254, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.14% (2.2022 => 2.2494, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (4.2646 => 4.3340, std. dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 1.61% (5.7591 => 5.8519, std. dev.: 0.0168) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.5415 => 1.5658, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 1.49% (0.7835 => 0.7952, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.9449 => 5.0156, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (9.4845 => 9.6143, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.35% (5.0018 => 5.0694, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.33% (3.3354 => 3.3797, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.31% (0.8067 => 0.8173, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.27% (2.0273 => 2.0530, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (8.1363 => 8.2353, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 1.09% (1.1642 => 1.1769, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.08% (1.5603 => 1.5771, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1861 => 1.1981, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7457, std. dev.: 0.0324) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.81% (0.8651 => 0.7283, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.02% (5.2763 => 4.8004, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.71% (2.9384 => 2.7119, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.04% (1.1194 => 1.0518, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3284, std. dev.: 0.0422) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.18% (6.6874 => 6.4076, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -2.84% (22.1758 => 21.5467, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0923, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 12:07:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 14:07:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622190707.29C172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1388?compare_to=1386&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1388, Order: 159013, Start Time: 2012-06-22 18:11:51, End Time: 2012-06-22 19:08:37 To: 1386, Order: 159001, Start Time: 2012-06-22 16:48:18, End Time: 2012-06-22 17:44:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 4 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.46% (12.5179 => 12.0854, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.7135 => 4.6545, std. dev.: 0.0030) MultiSource/Applications/siod/siod: -1.09% (3.2873 => 3.2515, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3155 => 2.2915, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.63% (2.0176 => 2.2926, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7038 => 0.7469, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5818 => 0.6166, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5748 => 0.6073, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.61% (1.3693 => 1.4461, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7061 => 0.7439, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (3.9660 => 4.1645, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.2781 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.82% (0.2655 => 0.2783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.5265 => 0.5513, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.7710 => 0.8067, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.60% (0.2628 => 0.2749, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.6959 => 0.7278, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2726 => 0.2850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.53% (0.2761 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.49% (1.9828 => 2.0719, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3149 => 0.3283, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2815, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.18% (13.8202 => 14.3985, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.9199 => 0.9569, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.02% (0.2988 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3192 => 0.3316, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.88% (1.4563 => 1.5128, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.73% (1.0594 => 1.0989, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.56% (16.6129 => 17.2041, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.3245 => 1.3713, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (3.8646 => 4.0004, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.2193 => 1.2616, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5577 => 0.5766, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 3.23% (1.9270 => 1.9893, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.23% (1.1061 => 1.1418, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.21% (0.8310 => 0.8577, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.04% (0.7506 => 0.7734, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.99% (2.1791 => 2.2443, std. dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1328, std. dev.: 0.0121) SingleSource/UnitTests/ObjC/parameter-passing: 2.82% (0.4003 => 0.4116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (13.2842 => 13.6562, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.76% (0.3914 => 0.4022, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (3.6692 => 3.7691, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2577, std. dev.: 0.0189) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.3813 => 1.4181, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 2.64% (0.3789 => 0.3889, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4172, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.54% (0.6135 => 0.6291, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (7.2180 => 7.3941, std. dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.5754 => 6.7329, std. dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.3801 => 4.4714, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.91% (3.1889 => 3.2498, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (4.4433 => 4.5276, std. dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (1.2749 => 1.2986, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1541, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (3.2742 => 3.3323, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1331, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (8.4961 => 8.6255, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4973, std. dev.: 0.0102) MultiSource/Applications/ClamAV/clamscan: 1.45% (14.5298 => 14.7401, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.39% (1.5188 => 1.5399, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 25.98% (1.8175 => 2.2896, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.54% (1.2998 => 1.3978, std. dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7381, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.36% (1.7688 => 1.8282, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6051, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.73% (7.9275 => 8.1439, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6545, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8558, std. dev.: 0.0224) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.58% (0.4657 => 0.3885, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.67% (22.5627 => 21.0578, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.18% (0.8818 => 0.8626, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1001, std. dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6048, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.33% (20.3410 => 19.8669, std. dev.: 0.0504) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7754, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9850, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.8887 => 3.8437, std. dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 12:48:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 14:48:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622194817.DFF4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1389?compare_to=1387&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1389, Order: 159017, Start Time: 2012-06-22 18:49:00, End Time: 2012-06-22 19:49:48 To: 1387, Order: 159006, Start Time: 2012-06-22 17:21:14, End Time: 2012-06-22 18:22:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (33 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.05% (10.3673 => 11.2022, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.32% (0.3543 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3497 => 0.3708, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.02% (0.3473 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.96% (0.3543 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.81% (0.3561 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3516 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.63% (0.3694 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.46% (0.3828 => 0.4037, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.3927 => 0.4137, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 5.28% (0.3886 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.73% (0.6030 => 0.6255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5925 => 0.6135, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.38% (7.0540 => 7.2923, std. dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: 2.85% (0.7433 => 0.7645, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (10.4361 => 10.7119, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.90% (21.9371 => 22.3539, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (2.2022 => 2.2390, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (4.2646 => 4.3339, std. dev.: 0.0127) MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.39% (5.7591 => 5.8389, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.5415 => 1.5623, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.34% (0.8067 => 0.8175, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.28% (2.0273 => 2.0533, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.23% (3.3354 => 3.3765, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (4.9449 => 5.0054, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (9.4845 => 9.5996, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (5.0018 => 5.0553, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.02% (1.1642 => 1.1761, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.00% (1.1861 => 1.1980, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7443, std. dev.: 0.0392) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.61% (0.8651 => 0.7301, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.11% (5.2763 => 4.7955, std. dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.13% (2.9384 => 2.6994, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0476, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3102, std. dev.: 0.0423) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.23% (6.6874 => 6.4048, std. dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: -2.99% (22.1758 => 21.5134, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0919, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 13:20:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 15:20:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622202050.3C7542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1390?compare_to=1385&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1390, Order: 159013, Start Time: 2012-06-22 18:07:00, End Time: 2012-06-22 20:22:20 To: 1385, Order: 158994, Start Time: 2012-06-22 15:24:46, End Time: 2012-06-22 17:40:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (22 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 5.72% (0.3446 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.60% (0.3465 => 0.3659, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3488 => 0.3683, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 5.55% (0.3460 => 0.3652, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.52% (0.3442 => 0.3632, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.45% (0.3469 => 0.3658, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.43% (0.3496 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.24% (0.3643 => 0.3834, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 5.15% (0.3650 => 0.3838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.99% (0.3724 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5826 => 0.6015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.09% (0.5889 => 0.6071, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7171 => 0.7359, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (0.5026 => 0.5130, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.5900 => 0.6012, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.84% (1.6211 => 1.6509, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (1.3152 => 1.3361, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.53% (3.5627 => 3.6173, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 1.24% (4.2109 => 4.2630, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 1.19% (0.9909 => 1.0027, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.13% (2.0673 => 2.0906, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 1.04% (1.5932 => 1.6098, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.28% (2.4764 => 2.3951, std. dev.: 0.0230) MultiSource/Applications/kimwitu++/kc: -2.78% (11.9555 => 11.6234, std. dev.: 0.0139) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 13:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 15:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622203043.12AA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1391?compare_to=1388&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1391, Order: 159020, Start Time: 2012-06-22 19:35:31, End Time: 2012-06-22 20:32:13 To: 1388, Order: 159013, Start Time: 2012-06-22 18:11:51, End Time: 2012-06-22 19:08:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.18% (25.8888 => 26.1938, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.03% (2.2443 => 2.2211, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.5818 => 0.6183, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.05% (0.5748 => 0.6096, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7061 => 0.7452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.32% (1.3693 => 1.4421, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.64% (0.2781 => 0.2910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2760 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.41% (0.2628 => 0.2744, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.41% (1.9828 => 2.0702, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (0.2655 => 0.2772, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.38% (3.9660 => 4.1397, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.35% (0.2761 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.7710 => 0.8043, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.28% (0.2596 => 0.2707, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.26% (0.3899 => 0.4065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3489 => 0.3637, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.5265 => 0.5478, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3453 => 0.3590, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3868 => 0.3997, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.4390 => 0.4536, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.9199 => 0.9501, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.4563 => 1.4984, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (1.1364 => 1.1688, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 2.67% (0.4003 => 0.4110, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0558, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (3.8646 => 3.9668, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 2.64% (0.3789 => 0.3889, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.58% (0.5577 => 0.5721, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 2.58% (0.3914 => 0.4015, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.46% (0.7506 => 0.7691, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.42% (1.9270 => 1.9736, std. dev.: 0.0128) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.39% (1.3813 => 1.4143, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.31% (3.6692 => 3.7541, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (13.2842 => 13.5888, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (4.9865 => 5.0999, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.23% (14.8535 => 15.1854, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4125, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (7.2180 => 7.3611, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2211, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7010, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6135 => 0.6251, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8698 => 0.8849, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.3801 => 4.4465, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.39% (3.1889 => 3.2332, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (4.4433 => 4.5050, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1333 => 1.1470, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.32% (0.9996 => 1.0828, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.74% (1.2998 => 1.4004, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7278, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6051, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1309, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.5928 => 4.6525, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1938, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9520, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5980, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1075, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9936, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2551, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7756, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4870, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9852, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2551, std. dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 14:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 16:16:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622211602.04F0B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1392?compare_to=1389&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1392, Order: 159020, Start Time: 2012-06-22 20:16:40, End Time: 2012-06-22 21:17:32 To: 1389, Order: 159017, Start Time: 2012-06-22 18:49:00, End Time: 2012-06-22 19:49:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (24 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (839 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 8.20% (0.4025 => 0.4355, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.09% (0.3817 => 0.4355, std. dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 8.71% (10.3673 => 11.2708, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3473 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3497 => 0.3698, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3543 => 0.3745, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3516 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.67% (0.3543 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.64% (0.3561 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.52% (0.3694 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.30% (0.3828 => 0.4031, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 5.27% (0.3927 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.10% (0.3886 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.94% (0.6030 => 0.6207, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.89% (0.5925 => 0.6096, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (7.0540 => 7.2235, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 2.31% (0.7433 => 0.7605, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (10.4361 => 10.6591, std. dev.: 0.0180) SingleSource/UnitTests/ObjC++/property-reference: 1.97% (0.7326 => 0.7470, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.75% (21.9371 => 22.3211, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (2.2022 => 2.2358, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (0.8172 => 0.8290, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 1.36% (5.7591 => 5.8374, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.01% (4.2646 => 4.3075, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7541, std. dev.: 0.0312) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.84% (0.8651 => 0.7281, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7881, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.15% (2.9384 => 2.6989, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.45% (1.1194 => 1.0472, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.10% (54.1659 => 51.4018, std. dev.: 0.0432) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (6.6874 => 6.3990, std. dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: -3.30% (22.1758 => 21.4434, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0927, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 15:21:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 17:21:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622222144.42F402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1393?compare_to=1391&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1393, Order: 159030, Start Time: 2012-06-22 21:26:25, End Time: 2012-06-22 22:23:12 To: 1391, Order: 159020, Start Time: 2012-06-22 19:35:31, End Time: 2012-06-22 20:32:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.31% (3.8444 => 3.7942, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2824, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.5818 => 0.6209, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.12% (0.7061 => 0.7493, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.58% (0.7038 => 0.7431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.37% (1.3693 => 1.4428, std. dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.99% (0.2765 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3580 => 0.3757, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.83% (1.9828 => 2.0785, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.3489 => 0.3657, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.59% (0.3485 => 0.3645, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.53% (3.9660 => 4.1456, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.7710 => 0.8050, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5265 => 0.5487, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.05% (0.4390 => 0.4568, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.3534 => 0.3672, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.6959 => 0.7223, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.75% (13.8202 => 14.3388, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9199 => 0.9518, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.4563 => 1.5020, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 3.00% (16.6129 => 17.1114, std. dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (1.2193 => 1.2548, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3626, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (3.8646 => 3.9746, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.73% (0.5577 => 0.5729, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.65% (0.4003 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.63% (0.3914 => 0.4017, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1146, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.56% (1.9270 => 1.9763, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.54% (0.7506 => 0.7697, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4158, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.2842 => 13.6071, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (1.3819 => 1.4143, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.25% (14.8535 => 15.1872, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.8698 => 0.8893, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (3.6692 => 3.7503, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (7.2180 => 7.3733, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2254, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7078, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.3801 => 4.4539, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.61% (3.1889 => 3.2404, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.4433 => 4.5087, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.1333 => 1.1485, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6772, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2745, std. dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7292, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.78% (12.4560 => 12.9273, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.02% (11.2619 => 11.6023, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (7.9275 => 8.1423, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8562, std. dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9630, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3511 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.39% (0.9108 => 0.8981, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.06% (1.3780 => 1.3221, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -2.64% (9.3358 => 9.0889, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5984, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5104, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9751, std. dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7741, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2562, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9840, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2544, std. dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 15:43:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 17:43:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120622224341.57AE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1394?compare_to=1392&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1394, Order: 159030, Start Time: 2012-06-22 21:44:33, End Time: 2012-06-22 22:45:11 To: 1392, Order: 159020, Start Time: 2012-06-22 20:16:40, End Time: 2012-06-22 21:17:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.22% (3.7768 => 3.8605, std. dev.: 0.0285) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.21% (11.2708 => 10.9094, std. dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3473 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3543 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.37% (0.3561 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.37% (0.3516 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.29% (0.3543 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.17% (0.3694 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.96% (0.3828 => 0.4056, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.94% (0.3886 => 0.4117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.93% (0.3927 => 0.4160, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 5.23% (10.3673 => 10.9094, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5925 => 0.6149, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.65% (0.6030 => 0.6250, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.85% (0.7326 => 0.7535, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (0.7433 => 0.7632, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.34% (0.4615 => 0.4723, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.00% (7.0540 => 7.1950, std. dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (10.4361 => 10.6216, std. dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 1.69% (21.9371 => 22.3087, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.8172 => 0.8310, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 1.52% (0.7835 => 0.7954, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3181, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.20% (1.5415 => 1.5600, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (4.9449 => 5.0000, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7591 => 5.8225, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (2.2022 => 2.2252, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1861 => 1.1982, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7419, std. dev.: 0.0197) MultiSource/Benchmarks/llubenchmark/llu: 2.18% (3.7781 => 3.8605, std. dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3180, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.80% (0.8651 => 0.7284, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7881, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.12% (2.9384 => 2.6997, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (1.1194 => 1.0469, std. dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3658, std. dev.: 0.0453) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.97% (6.6874 => 6.4216, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -3.22% (22.1758 => 21.4623, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.05% (1.7609 => 1.7424, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0918, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.13% (1.4460 => 1.4297, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 16:31:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 18:31:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120622233113.6CC942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1395?compare_to=1390&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1395, Order: 159030, Start Time: 2012-06-22 21:17:15, End Time: 2012-06-22 23:32:44 To: 1390, Order: 159013, Start Time: 2012-06-22 18:07:00, End Time: 2012-06-22 20:22:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (24 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 892 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.20% (2.3951 => 2.4239, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 1.01% (1.6098 => 1.6261, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.07% (0.3446 => 0.3655, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.04% (0.3460 => 0.3669, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3465 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.02% (0.3488 => 0.3698, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.96% (0.3442 => 0.3647, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.94% (0.3469 => 0.3675, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.92% (0.3496 => 0.3703, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.68% (0.3643 => 0.3850, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.67% (0.3650 => 0.3857, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 5.37% (0.3724 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.47% (0.5826 => 0.6028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.14% (0.5889 => 0.6074, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7171 => 0.7380, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (0.5026 => 0.5164, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.37% (1.6211 => 1.6596, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.5900 => 0.6031, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (1.3152 => 1.3425, std. dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 2.07% (1.5932 => 1.6261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (3.5627 => 3.6326, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 1.79% (4.2109 => 4.2864, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.60% (1.0781 => 1.0954, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.24% (0.9909 => 1.0032, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (4.4195 => 4.4717, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.10% (23.5202 => 23.7785, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.66% (11.9555 => 11.6371, std. dev.: 0.0115) SingleSource/UnitTests/Vector/constpool: -2.12% (2.4764 => 2.4239, std. dev.: 0.0029) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 16:45:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 18:45:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120622234521.F1B532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1396?compare_to=1393&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1396, Order: 159038, Start Time: 2012-06-22 22:50:08, End Time: 2012-06-22 23:46:51 To: 1393, Order: 159030, Start Time: 2012-06-22 21:26:25, End Time: 2012-06-22 22:23:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.08% (2.0176 => 2.2816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.5818 => 0.6161, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.71% (0.5748 => 0.6076, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7061 => 0.7437, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 5.21% (0.7038 => 0.7405, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4374, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4062 => 0.4262, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.60% (0.2781 => 0.2909, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.50% (3.9660 => 4.1444, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2782 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.41% (0.2607 => 0.2722, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.7710 => 0.8050, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.2726 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2690 => 0.2807, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.35% (0.2966 => 0.3095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.34% (0.2765 => 0.2885, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.30% (1.9828 => 2.0681, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3485 => 0.3630, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2788, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5265 => 0.5477, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.82% (0.3192 => 0.3314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2988 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4016 => 0.4163, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.64% (13.8202 => 14.3227, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.3756 => 0.3889, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (0.4390 => 0.4540, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3534 => 0.3653, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (1.4563 => 1.5001, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1057, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (1.2193 => 1.2548, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1684, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (3.8646 => 3.9711, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.65% (0.5577 => 0.5725, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.51% (1.9270 => 1.9754, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.40% (4.9865 => 5.1060, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6025, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4140, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.31% (3.6692 => 3.7539, std. dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (1.3819 => 1.4129, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.21% (14.8535 => 15.1818, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (7.2180 => 7.3668, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.90% (6.5754 => 6.7001, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.8698 => 0.8862, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.3801 => 4.4520, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.61% (3.1889 => 3.2404, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (4.4433 => 4.5066, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7029, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 26.62% (1.8175 => 2.3014, std. dev.: 0.0355) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 7.23% (1.2998 => 1.3938, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7228, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6040, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1567, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.5928 => 4.6514, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9528, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.14% (10.7476 => 10.8702, std. dev.: 0.0411) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.34% (0.4657 => 0.3896, std. dev.: 0.0227) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9461, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.96% (0.3511 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.6576 => 0.6470, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.28% (1.3780 => 1.3190, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5729, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: -2.50% (9.3358 => 9.1025, std. dev.: 0.0262) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9423, std. dev.: 0.0454) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7797, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.31% (3.0263 => 2.9868, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2530, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 17:11:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 19:11:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623001121.A36C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1397?compare_to=1394&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1397, Order: 159042, Start Time: 2012-06-22 23:12:10, End Time: 2012-06-23 00:12:52 To: 1394, Order: 159030, Start Time: 2012-06-22 21:44:33, End Time: 2012-06-22 22:45:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (10.9094 => 11.0879, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.95% (10.3673 => 11.0879, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3473 => 0.3688, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.10% (0.3543 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.07% (0.3561 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.01% (0.3497 => 0.3707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.87% (0.3543 => 0.3751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.79% (0.3694 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3828 => 0.4038, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.47% (0.3927 => 0.4142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.43% (0.3886 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5925 => 0.6125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.37% (0.6030 => 0.6233, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.80% (0.7433 => 0.7641, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.61% (0.7326 => 0.7517, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (7.0540 => 7.2265, std. dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (10.4361 => 10.6433, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.87% (21.9371 => 22.3473, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.8172 => 0.8316, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (2.2022 => 2.2350, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (4.2646 => 4.3258, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (4.9449 => 5.0053, std. dev.: 0.0105) MultiSource/Applications/d/make_dparser: 1.20% (3.3354 => 3.3754, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8252, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (5.0018 => 5.0574, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (8.1363 => 8.2240, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7607, std. dev.: 0.0201) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.74% (0.8651 => 0.7289, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.11% (5.2763 => 4.7957, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (2.9384 => 2.7107, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.20% (1.1194 => 1.0500, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4431, std. dev.: 0.0406) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.75% (6.6874 => 6.4366, std. dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: -2.93% (22.1758 => 21.5252, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0921, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.01% (1.4460 => 1.4314, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 18:09:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 20:09:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623010911.CFF942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1398?compare_to=1396&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1398, Order: 159046, Start Time: 2012-06-23 00:13:50, End Time: 2012-06-23 01:10:41 To: 1396, Order: 159038, Start Time: 2012-06-22 22:50:08, End Time: 2012-06-22 23:46:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.68% (3.7659 => 3.8292, std. dev.: 0.0205) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.47% (2.0176 => 2.2893, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.96% (0.5818 => 0.6165, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.79% (0.5748 => 0.6081, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.51% (0.7038 => 0.7426, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7061 => 0.7438, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 5.20% (1.3693 => 1.4405, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1521, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.46% (0.7710 => 0.8054, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.41% (0.2607 => 0.2722, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.2726 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.35% (0.2690 => 0.2807, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3489 => 0.3637, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.24% (0.6959 => 0.7254, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2628 => 0.2739, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.9828 => 2.0665, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2292 => 1.2806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3453 => 0.3590, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3571, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4016 => 0.4170, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.55% (0.4390 => 0.4546, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3534 => 0.3658, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5052, std. dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 3.28% (16.6129 => 17.1574, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3660, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9831, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.06% (1.2193 => 1.2566, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5577 => 0.5741, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1693, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (4.9865 => 5.1248, std. dev.: 0.0156) MultiSource/Applications/treecc/treecc: 2.75% (1.9270 => 1.9800, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.75% (1.1061 => 1.1365, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 2.72% (0.4003 => 0.4112, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.68% (0.7506 => 0.7707, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.64% (0.8310 => 0.8529, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.3813 => 1.4160, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2336, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2159, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (3.6692 => 3.7561, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5952, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (7.2180 => 7.3863, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.8698 => 0.8890, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.08% (6.5754 => 6.7124, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2444, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (4.3801 => 4.4534, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (4.4433 => 4.5133, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1498, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3104, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.5298 => 14.6828, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1221, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.18% (1.8175 => 2.2934, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7363, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.06% (11.2619 => 11.6061, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1389, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.49% (3.7731 => 3.8292, std. dev.: 0.0205) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.37% (4.5928 => 4.6555, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.09% (1.9290 => 1.9500, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.5627 => 20.9805, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3511 => 0.3390, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5896, std. dev.: 0.0311) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.64% (20.3410 => 19.8048, std. dev.: 0.0779) MultiSource/Applications/minisat/minisat: -2.50% (9.3358 => 9.1023, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4993, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7756, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9859, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.20% (0.9692 => 0.9576, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2524, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 18:39:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 20:39:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623013914.56A822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1399?compare_to=1397&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1399, Order: 159054, Start Time: 2012-06-23 00:40:00, End Time: 2012-06-23 01:40:44 To: 1397, Order: 159042, Start Time: 2012-06-22 23:12:10, End Time: 2012-06-23 00:12:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (24 on baseline) Performance Improvements: 2 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (839 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.64% (11.0879 => 10.7950, std. dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.29% (3.8700 => 3.7812, std. dev.: 0.0238) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.44% (0.3473 => 0.3662, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.39% (0.3543 => 0.3734, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.32% (0.3497 => 0.3683, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.28% (0.3543 => 0.3730, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.23% (0.3516 => 0.3700, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.22% (0.3561 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.06% (0.3694 => 0.3881, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 4.91% (0.3927 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.89% (0.3828 => 0.4015, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.79% (0.3886 => 0.4072, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 4.13% (10.3673 => 10.7950, std. dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (7.0540 => 7.2364, std. dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.7433 => 0.7609, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (10.4361 => 10.6588, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.07% (21.9371 => 22.3905, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.95% (2.2022 => 2.2451, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 1.89% (0.5925 => 0.6037, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 1.87% (0.6030 => 0.6143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.87% (0.7326 => 0.7463, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (0.8172 => 0.8284, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.9449 => 5.0040, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8269, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.05% (4.2646 => 4.3093, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.57% (26.0924 => 26.7641, std. dev.: 0.0453) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.57% (0.8651 => 0.7304, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (5.2763 => 4.7986, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.82% (2.9384 => 2.7087, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (1.1194 => 1.0515, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -5.10% (54.1659 => 51.4059, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.83% (6.6874 => 6.4310, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -3.23% (22.1758 => 21.4599, std. dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0925, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4303, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 19:13:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 21:13:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623021319.D2CC42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1400?compare_to=1395&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1400, Order: 159045, Start Time: 2012-06-22 23:59:30, End Time: 2012-06-23 02:14:50 To: 1395, Order: 159030, Start Time: 2012-06-22 21:17:15, End Time: 2012-06-22 23:32:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (25 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.72% (2.0530 => 2.1088, std. dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.41% (0.3465 => 0.3687, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3446 => 0.3663, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 6.29% (0.3496 => 0.3716, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.24% (0.3460 => 0.3676, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.17% (0.3469 => 0.3683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.16% (0.3488 => 0.3703, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.13% (0.3442 => 0.3653, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3643 => 0.3856, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.78% (0.3650 => 0.3861, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 5.53% (0.3724 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.33% (0.5826 => 0.6020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.09% (0.5889 => 0.6071, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (0.5026 => 0.5175, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.52% (0.7171 => 0.7352, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (1.6211 => 1.6610, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.5900 => 0.6026, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 2.13% (1.5932 => 1.6272, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (1.3152 => 1.3425, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (3.5627 => 3.6364, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (0.4994 => 0.5097, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.77% (4.2109 => 4.2855, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0673 => 2.0949, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.21% (0.9909 => 1.0029, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.15% (4.6177 => 4.6709, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (4.4195 => 4.4676, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.54% (11.9555 => 11.6523, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -2.35% (2.4764 => 2.4181, std. dev.: 0.0028) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 19:33:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 21:33:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623023303.31EF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1401?compare_to=1398&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1401, Order: 159059, Start Time: 2012-06-23 01:37:45, End Time: 2012-06-23 02:34:33 To: 1398, Order: 159046, Start Time: 2012-06-23 00:13:50, End Time: 2012-06-23 01:10:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.34% (7.9456 => 8.0524, std. dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.03% (2.0176 => 2.2805, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.5818 => 0.6146, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7038 => 0.7425, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.38% (1.3693 => 1.4430, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.22% (0.5748 => 0.6048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 4.96% (0.7061 => 0.7411, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2655 => 0.2782, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.72% (0.2966 => 0.3106, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.7710 => 0.8073, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.3489 => 0.3653, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1513, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3580 => 0.3745, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2760 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.53% (0.2761 => 0.2886, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.49% (1.9828 => 2.0719, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.27% (0.5265 => 0.5490, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.23% (0.2696 => 0.2810, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.15% (1.2292 => 1.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.93% (13.8202 => 14.3633, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.6959 => 0.7225, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4390 => 0.4548, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3868 => 0.4007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3534 => 0.3660, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.4563 => 1.5043, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 3.09% (16.6129 => 17.1259, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/parameter-passing: 3.05% (0.4003 => 0.4125, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1710, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 2.99% (0.3578 => 0.3685, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.99% (0.3914 => 0.4031, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 2.96% (0.3789 => 0.3901, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (3.8646 => 3.9766, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 2.87% (0.3663 => 0.3768, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 2.80% (0.3601 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.80% (0.3646 => 0.3748, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.77% (0.3940 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.74% (0.3650 => 0.3750, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.73% (1.9270 => 1.9796, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1208, std. dev.: 0.0192) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (3.6692 => 3.7575, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2099, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.8698 => 0.8905, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5927, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (1.3813 => 1.4125, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.22% (7.2180 => 7.3783, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.94% (6.5754 => 6.7028, std. dev.: 0.0107) MultiSource/Applications/d/make_dparser: 1.80% (3.1889 => 3.2463, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4559, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.4433 => 4.5116, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1333 => 1.1505, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4404, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.2742 => 3.3078, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6771, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.83% (1.2998 => 1.3886, std. dev.: 0.0183) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7014, std. dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.02% (11.2619 => 11.6024, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1363, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6538, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 1.02% (10.7476 => 10.8575, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9884, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3511 => 0.3376, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5769, std. dev.: 0.0352) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1049, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5000, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 20.0001, std. dev.: 0.0856) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7760, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.29% (3.0263 => 2.9874, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.12% (7.3305 => 7.2481, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 20:06:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 22:06:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623030656.48E392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1402?compare_to=1399&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1402, Order: 159059, Start Time: 2012-06-23 02:07:47, End Time: 2012-06-23 03:08:27 To: 1399, Order: 159054, Start Time: 2012-06-23 00:40:00, End Time: 2012-06-23 01:40:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (24 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (838 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.72% (2.2720 => 2.3566, std. dev.: 0.0144) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.44% (0.3473 => 0.3662, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.39% (0.3543 => 0.3734, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.23% (0.3497 => 0.3680, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.20% (0.3516 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.19% (0.3543 => 0.3727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.17% (0.3561 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.06% (0.3694 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.02% (0.3927 => 0.4124, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 4.94% (0.3886 => 0.4078, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 4.89% (0.3828 => 0.4015, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.45% (10.3673 => 10.8291, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (7.0540 => 7.2401, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7433 => 0.7624, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 2.19% (0.5925 => 0.6055, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.12% (0.6030 => 0.6158, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (10.4361 => 10.6211, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.66% (21.9371 => 22.3005, std. dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8323, std. dev.: 0.0147) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3733, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.9449 => 5.0008, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.01% (4.2646 => 4.3078, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.49% (2.2771 => 2.3566, std. dev.: 0.0144) MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7739, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.44% (0.8651 => 0.7229, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.03% (5.2763 => 4.8000, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (2.9384 => 2.7046, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.31% (1.1194 => 1.0488, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4221, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.74% (6.6874 => 6.4371, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -3.32% (22.1758 => 21.4393, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.29% (1.7609 => 1.7381, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0932, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4313, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 20:56:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 22:56:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623035644.DB0A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1403?compare_to=1401&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1403, Order: 159061, Start Time: 2012-06-23 03:01:29, End Time: 2012-06-23 03:58:15 To: 1401, Order: 159059, Start Time: 2012-06-23 01:37:45, End Time: 2012-06-23 02:34:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.72% (1.3886 => 1.4125, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2951, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.36% (0.5818 => 0.6130, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (0.4328 => 0.4557, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7038 => 0.7409, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7061 => 0.7426, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.13% (1.3693 => 1.4396, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 5.10% (0.5748 => 0.6041, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.7710 => 0.8075, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (3.9660 => 4.1524, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.48% (0.5265 => 0.5501, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4062 => 0.4237, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.28% (0.2966 => 0.3093, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2655 => 0.2765, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.13% (0.2690 => 0.2801, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2760 => 0.2873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.09% (0.2937 => 0.3057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.99% (0.6959 => 0.7237, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2726 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.95% (1.9828 => 2.0611, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.89% (0.3107 => 0.3228, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.88% (0.2761 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.74% (13.8202 => 14.3369, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.68% (0.3149 => 0.3265, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4016 => 0.4162, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 3.51% (0.3192 => 0.3304, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5063, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.34% (0.3293 => 0.3403, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4390 => 0.4530, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 3.05% (0.3578 => 0.3687, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2563, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 3.01% (0.3789 => 0.3903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.00% (0.3868 => 0.3984, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.1364 => 1.1703, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 2.96% (0.3914 => 0.4030, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.94% (16.6129 => 17.1017, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 2.90% (0.4003 => 0.4119, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 2.88% (0.3646 => 0.3751, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (3.8646 => 3.9748, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 2.84% (0.3663 => 0.3767, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.82% (1.1061 => 1.1373, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.81% (0.7506 => 0.7717, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 2.80% (0.3601 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 2.79% (0.3940 => 0.4050, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.77% (1.9270 => 1.9804, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.77% (0.3650 => 0.3751, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (13.2842 => 13.6291, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7601, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.45% (4.9865 => 5.1085, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2084, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4146, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (7.2180 => 7.3816, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2277, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.05% (6.5754 => 6.7100, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.3801 => 4.4593, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.8698 => 0.8845, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.4433 => 4.5175, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.66% (3.1889 => 3.2419, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.59% (1.1333 => 1.1513, std. dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3075, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/mandel-2: 8.67% (1.2998 => 1.4125, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9996 => 1.0813, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7229, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6036, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1410, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6544, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9980, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.26% (0.9108 => 0.8993, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5811, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.42% (9.3358 => 9.1097, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9051, std. dev.: 0.0307) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7757, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -1.34% (3.0263 => 2.9857, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.3305 => 7.2560, std. dev.: 0.0250) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 21:34:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 23:34:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623043438.E5BFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1404?compare_to=1402&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1404, Order: 159061, Start Time: 2012-06-23 03:35:26, End Time: 2012-06-23 04:36:09 To: 1402, Order: 159059, Start Time: 2012-06-23 02:07:47, End Time: 2012-06-23 03:08:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (27 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (835 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.02% (2.3566 => 2.2854, std. dev.: 0.0201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.01% (0.3497 => 0.3707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.96% (0.3543 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.87% (0.3543 => 0.3751, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.66% (0.3694 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.51% (0.3828 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3927 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.80% (10.3673 => 10.7617, std. dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7433 => 0.7627, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (7.0540 => 7.2381, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.8172 => 0.8360, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.08% (21.9371 => 22.3926, std. dev.: 0.0176) MultiSource/Applications/spiff/spiff: 2.04% (0.7835 => 0.7995, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (10.4361 => 10.6393, std. dev.: 0.0104) SingleSource/UnitTests/ObjC++/Hello: 1.94% (0.5925 => 0.6040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.94% (0.6030 => 0.6147, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (2.2022 => 2.2379, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8433, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.9449 => 5.0058, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2646 => 4.3140, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.06% (3.3354 => 3.3706, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.0018 => 5.0529, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.69% (26.0924 => 26.7937, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.46% (0.8651 => 0.7227, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.15% (5.2763 => 4.7934, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.99% (2.9384 => 2.7036, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (1.1194 => 1.0498, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4557, std. dev.: 0.0384) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.92% (6.6874 => 6.4255, std. dev.: 0.0289) MultiSource/Applications/ClamAV/clamscan: -3.20% (22.1758 => 21.4665, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.02% (1.7609 => 1.7430, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0926, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4313, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 21:55:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 22 Jun 2012 23:55:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623045532.6359F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1405?compare_to=1400&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1405, Order: 159060, Start Time: 2012-06-23 02:41:39, End Time: 2012-06-23 04:57:01 To: 1400, Order: 159045, Start Time: 2012-06-22 23:59:30, End Time: 2012-06-23 02:14:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 10.47% (0.3792 => 0.4189, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3460 => 0.3689, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3446 => 0.3671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.52% (0.3465 => 0.3691, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.51% (0.3488 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3442 => 0.3665, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.46% (0.3496 => 0.3722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.46% (0.3469 => 0.3693, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3643 => 0.3870, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.19% (0.3650 => 0.3876, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3724 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.09% (0.5826 => 0.6006, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (0.5026 => 0.5178, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.78% (0.5889 => 0.6053, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (1.6211 => 1.6617, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.27% (0.7171 => 0.7334, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.5900 => 0.6030, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (3.5627 => 3.6382, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (1.3152 => 1.3422, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.78% (4.2109 => 4.2857, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (2.0673 => 2.1034, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.62% (1.0781 => 1.0956, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.52% (0.9909 => 1.0060, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (4.4195 => 4.4731, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (1.9694 => 1.9922, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.45% (11.9555 => 11.6622, std. dev.: 0.0090) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 22:56:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 00:56:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623055614.9B3292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1406?compare_to=1403&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1406, Order: 159070, Start Time: 2012-06-23 05:00:56, End Time: 2012-06-23 05:57:44 To: 1403, Order: 159061, Start Time: 2012-06-23 03:01:29, End Time: 2012-06-23 03:58:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.51% (3.7619 => 3.8563, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.45% (2.0176 => 2.2889, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.43% (0.5818 => 0.6134, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5748 => 0.6037, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.96% (1.3693 => 1.4372, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 4.73% (0.7061 => 0.7395, std. dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: 4.72% (0.7038 => 0.7370, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.42% (3.9660 => 4.1411, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.40% (0.7710 => 0.8049, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.28% (0.4062 => 0.4236, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2596 => 0.2706, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.05% (0.2690 => 0.2799, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5265 => 0.5477, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2655 => 0.2761, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.91% (0.2966 => 0.3082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.89% (0.3107 => 0.3228, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.2937 => 0.3051, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2765 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2726 => 0.2829, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3489 => 0.3620, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.71% (1.9828 => 2.0563, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 3.65% (0.3149 => 0.3264, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.63% (0.3580 => 0.3710, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (0.3485 => 0.3610, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.3899 => 0.4035, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3009, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 3.42% (0.3453 => 0.3571, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4016 => 0.4147, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3192 => 0.3296, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.4563 => 1.5024, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3756 => 0.3872, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3293 => 0.3393, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.4390 => 0.4519, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 2.92% (0.3868 => 0.3981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.91% (0.3534 => 0.3637, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (1.2193 => 1.2531, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.3245 => 1.3607, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.69% (0.5577 => 0.5727, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.62% (1.9270 => 1.9775, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (13.2842 => 13.6301, std. dev.: 0.0171) SingleSource/UnitTests/ObjC/exceptions: 2.58% (0.3914 => 0.4015, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.50% (16.6129 => 17.0284, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 2.50% (0.4003 => 0.4103, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9610, std. dev.: 0.0112) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.31% (1.3813 => 1.4132, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.7460 => 0.7628, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.24% (3.6692 => 3.7513, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.21% (4.9865 => 5.0967, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.20% (1.3819 => 1.4123, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3700, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.10% (14.8535 => 15.1649, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6135 => 0.6251, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (6.5754 => 6.6975, std. dev.: 0.0119) MultiSource/Applications/siod/siod: 1.65% (2.1791 => 2.2150, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.8698 => 0.8833, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.3801 => 4.4461, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.47% (3.1889 => 3.2357, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (4.4433 => 4.5064, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.28% (1.2998 => 1.4074, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7196, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6059, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1290, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.21% (3.7731 => 3.8563, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6530, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 1.15% (10.7476 => 10.8710, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.20% (0.4657 => 0.3949, std. dev.: 0.0225) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9326, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.50% (0.3511 => 0.3388, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3210, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5983, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.54% (20.3410 => 19.8241, std. dev.: 0.0838) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1070, std. dev.: 0.0319) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7779, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9833, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2526, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 22 23:02:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 01:02:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623060212.83C302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1407?compare_to=1404&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1407, Order: 159070, Start Time: 2012-06-23 05:03:04, End Time: 2012-06-23 06:03:43 To: 1404, Order: 159061, Start Time: 2012-06-23 03:35:26, End Time: 2012-06-23 04:36:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (30 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.48% (10.7617 => 10.9206, std. dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.12% (7.9628 => 8.0520, std. dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.05% (0.3473 => 0.3683, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.92% (0.3516 => 0.3724, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3543 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.78% (0.3561 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.63% (0.3694 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.51% (0.3828 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.40% (0.3886 => 0.4096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.40% (0.3927 => 0.4139, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.34% (10.3673 => 10.9206, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (7.0540 => 7.2683, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8172 => 0.8381, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 2.39% (0.6030 => 0.6174, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.38% (0.7433 => 0.7610, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.31% (0.5925 => 0.6062, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.95% (21.9371 => 22.3656, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (10.4361 => 10.6301, std. dev.: 0.0144) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (2.2022 => 2.2420, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.68% (0.7326 => 0.7449, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.53% (5.7591 => 5.8470, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.30% (0.7835 => 0.7937, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.25% (4.9449 => 5.0065, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.2646 => 4.3170, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (8.1363 => 8.2275, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (9.4845 => 9.5878, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0556, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.01% (3.3354 => 3.3691, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7609, std. dev.: 0.0472) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.22% (0.8651 => 0.7248, std. dev.: 0.0182) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (5.2763 => 4.7966, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (2.9384 => 2.7062, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.06% (1.1194 => 1.0516, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4380, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.48% (6.6874 => 6.4544, std. dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: -3.09% (22.1758 => 21.4904, std. dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0921, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4306, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 00:23:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 02:23:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623072315.399282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1408?compare_to=1406&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1408, Order: 159072, Start Time: 2012-06-23 06:24:38, End Time: 2012-06-23 07:24:44 To: 1406, Order: 159070, Start Time: 2012-06-23 05:00:56, End Time: 2012-06-23 05:57:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (777 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2941, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.79% (0.5818 => 0.6155, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5748 => 0.6070, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4328 => 0.4552, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.93% (1.3693 => 1.4368, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 4.59% (0.7038 => 0.7361, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (3.9660 => 4.1472, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.43% (0.3022 => 0.3156, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 4.41% (0.2607 => 0.2722, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.38% (0.2966 => 0.3096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.17% (1.9828 => 2.0655, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3580 => 0.3726, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.87% (0.3485 => 0.3620, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.77% (0.3899 => 0.4046, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2292 => 1.2747, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.69% (0.6959 => 0.7216, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.66% (13.8202 => 14.3261, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 3.35% (0.3646 => 0.3768, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 3.23% (0.3623 => 0.3740, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 3.04% (0.7506 => 0.7734, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4996, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1685, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5577 => 0.5728, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2479, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (13.2842 => 13.6364, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.60% (3.6692 => 3.7646, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (1.3813 => 1.4168, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9632, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 2.48% (16.6129 => 17.0256, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0067) MultiSource/Applications/Burg/burg: 2.44% (1.1061 => 1.1331, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.39% (1.9270 => 1.9731, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (7.2180 => 7.3881, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.16% (4.9865 => 5.0940, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7128, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.78% (4.3801 => 4.4579, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2454, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.76% (4.4433 => 4.5215, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.8698 => 0.8844, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2514, std. dev.: 0.0562) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7227, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.1137) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.06% (11.2619 => 11.6062, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.81% (7.9275 => 8.1501, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6547, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9564, std. dev.: 0.3386) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.56% (0.8818 => 0.8592, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.21% (0.9108 => 0.8998, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.06% (1.3780 => 1.3221, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0214) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.28% (20.3410 => 19.6729, std. dev.: 0.1954) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0100) MultiSource/Applications/minisat/minisat: -2.53% (9.3358 => 9.0992, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.23% (0.8342 => 0.8156, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5146, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2495, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7756, std. dev.: 0.0785) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9830, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 00:32:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 02:32:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623073258.DDF462A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1409?compare_to=1407&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1409, Order: 159072, Start Time: 2012-06-23 06:30:36, End Time: 2012-06-23 07:34:29 To: 1407, Order: 159070, Start Time: 2012-06-23 05:03:04, End Time: 2012-06-23 06:03:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (20 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (845 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 8.20% (0.1622 => 0.1755, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3497 => 0.3734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3473 => 0.3707, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.63% (0.3543 => 0.3778, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3561 => 0.3796, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 6.54% (0.3516 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3543 => 0.3773, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3694 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3828 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.97% (0.3886 => 0.4118, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3927 => 0.4161, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.38% (10.3673 => 10.9251, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 2.85% (0.6030 => 0.6202, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 2.85% (0.5925 => 0.6094, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (10.4361 => 10.6750, std. dev.: 0.0329) SingleSource/UnitTests/ObjC++/property-reference: 2.05% (0.7326 => 0.7476, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.03% (21.9371 => 22.3818, std. dev.: 0.0320) MultiSource/Applications/oggenc/oggenc: 1.61% (5.7591 => 5.8517, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (9.4845 => 9.6104, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 1.19% (3.3354 => 3.3751, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.50% (0.8651 => 0.7310, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.45% (5.2763 => 4.8307, std. dev.: 0.1370) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.28% (2.9384 => 2.7246, std. dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.01% (1.1194 => 1.0521, std. dev.: 0.0105) SingleSource/UnitTests/Vector/constpool: -5.14% (54.1659 => 51.3832, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -2.99% (22.1758 => 21.5121, std. dev.: 0.0498) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0927, std. dev.: 0.0146) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 00:40:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 02:40:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623074014.F20B22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1410?compare_to=1405&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1410, Order: 159070, Start Time: 2012-06-23 05:23:46, End Time: 2012-06-23 07:41:44 To: 1405, Order: 159060, Start Time: 2012-06-23 02:41:39, End Time: 2012-06-23 04:57:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.47% (0.4189 => 0.4460, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.62% (0.3792 => 0.4460, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 6.83% (0.3442 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.79% (0.3488 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.73% (0.3446 => 0.3678, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.70% (0.3465 => 0.3697, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3460 => 0.3691, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3469 => 0.3699, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3496 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3643 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.28% (0.3724 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.25% (0.3650 => 0.3878, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (0.5026 => 0.5182, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.80% (0.5826 => 0.5989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.65% (0.5889 => 0.6045, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (1.6211 => 1.6631, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.38% (0.7171 => 0.7342, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (0.4994 => 0.5113, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (3.5627 => 3.6443, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.20% (0.5000 => 0.5110, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (1.3152 => 1.3441, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.5900 => 0.6027, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.98% (1.5932 => 1.6248, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0673 => 2.1055, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.70% (1.0781 => 1.0964, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.64% (0.9909 => 1.0072, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (1.9694 => 2.0010, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.45% (4.4195 => 4.4836, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (2.7292 => 2.7627, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (1.9966 => 2.0198, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.15% (1.8794 => 1.9011, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (2.1653 => 2.1877, std. dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.52% (11.9555 => 11.6544, std. dev.: 0.0099) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 02:32:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 04:32:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623093236.A3B8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1411?compare_to=1408&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1411, Order: 159073, Start Time: 2012-06-23 08:37:14, End Time: 2012-06-23 09:34:06 To: 1408, Order: 159072, Start Time: 2012-06-23 06:24:38, End Time: 2012-06-23 07:24:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.45% (19.6729 => 19.9591, std. dev.: 0.0565) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3002, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5818 => 0.6170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.76% (0.5748 => 0.6079, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7061 => 0.7430, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 5.21% (1.3693 => 1.4406, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.95% (0.4062 => 0.4263, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (3.9660 => 4.1585, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.7710 => 0.8076, std. dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2726 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.44% (0.2655 => 0.2773, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.43% (0.3022 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.41% (0.2628 => 0.2744, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.31% (1.9828 => 2.0683, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.23% (0.2696 => 0.2810, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.21% (0.3489 => 0.3636, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.16% (0.2765 => 0.2880, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3899 => 0.4060, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3192 => 0.3322, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2783, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3708, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.6959 => 0.7231, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9199 => 0.9533, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3534 => 0.3660, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.49% (1.0594 => 1.0964, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.4563 => 1.5040, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.2193 => 1.2583, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.18% (1.1364 => 1.1725, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.10% (0.3646 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.09% (0.3914 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.04% (0.3789 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3245 => 1.3644, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 2.98% (0.3663 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 2.93% (0.3623 => 0.3729, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.89% (0.7506 => 0.7723, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8646 => 3.9755, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.85% (1.1061 => 1.1376, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 2.84% (0.3940 => 0.4052, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.82% (16.6129 => 17.0821, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.75% (1.9270 => 1.9800, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (3.6692 => 3.7701, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.73% (1.3813 => 1.4190, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (13.2842 => 13.6438, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1170, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.8535 => 15.2398, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.3819 => 1.4178, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4113 => 0.4214, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6135 => 0.6284, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.7460 => 0.7640, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.38% (7.2180 => 7.3900, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.5754 => 6.7187, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.8698 => 0.8875, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.03% (2.1791 => 2.2234, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.3801 => 4.4667, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.83% (3.1889 => 3.2474, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (4.4433 => 4.5206, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1333 => 1.1517, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (1.2749 => 1.2953, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (8.4961 => 8.6004, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3142, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6913, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.35% (1.2998 => 1.4083, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7263, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8317, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6040, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1240, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6545, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2308 => 1.2462, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0160, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.42% (0.8818 => 0.8605, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5827, std. dev.: 0.0128) MultiSource/Applications/minisat/minisat: -2.59% (9.3358 => 9.0936, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9591, std. dev.: 0.0565) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2539, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7755, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0150) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2546, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 02:38:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 04:38:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623093849.955222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1412?compare_to=1409&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1412, Order: 159073, Start Time: 2012-06-23 08:39:27, End Time: 2012-06-23 09:40:19 To: 1409, Order: 159072, Start Time: 2012-06-23 06:30:36, End Time: 2012-06-23 07:34:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (33 on baseline) Performance Improvements: 1 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (831 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (10.9251 => 11.1504, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.86% (2.3284 => 2.2850, std. dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.55% (10.3673 => 11.1504, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.03% (0.3473 => 0.3717, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.00% (0.3543 => 0.3791, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.92% (0.3497 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/synchronized: 6.82% (0.3561 => 0.3804, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.66% (0.3694 => 0.3940, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.28% (0.3886 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.26% (0.5925 => 0.6118, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6030 => 0.6225, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (7.0540 => 7.2605, std. dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7433 => 0.7631, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.42% (0.7326 => 0.7503, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (10.4361 => 10.6798, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.8172 => 0.8356, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.07% (21.9371 => 22.3922, std. dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.84% (2.2022 => 2.2427, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 1.63% (5.7591 => 5.8528, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.58% (4.2646 => 4.3319, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.9449 => 5.0194, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.1363 => 8.2502, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (2.0665 => 2.0952, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.5415 => 1.5623, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.33% (5.0018 => 5.0684, std. dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (9.4845 => 9.6099, std. dev.: 0.0091) MultiSource/Applications/d/make_dparser: 1.32% (3.3354 => 3.3793, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1861 => 1.1981, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7748, std. dev.: 0.0326) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.50% (0.8651 => 0.7310, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.47% (5.2763 => 4.8292, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (2.9384 => 2.7091, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.32% (1.1194 => 1.0487, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4787, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.73% (6.6874 => 6.4381, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -2.94% (22.1758 => 21.5237, std. dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0927, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 03:23:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 05:23:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623102336.0B1AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1413?compare_to=1410&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1413, Order: 159072, Start Time: 2012-06-23 08:08:45, End Time: 2012-06-23 10:25:05 To: 1410, Order: 159070, Start Time: 2012-06-23 05:23:46, End Time: 2012-06-23 07:41:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (36 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 892 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 8.13% (0.2227 => 0.2408, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.37% (2.0857 => 2.0571, std. dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 29.93% (0.3792 => 0.4927, std. dev.: 0.0294) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3488 => 0.3748, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.45% (0.3465 => 0.3723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3446 => 0.3702, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3442 => 0.3697, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 7.41% (0.3469 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.41% (0.3496 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3460 => 0.3716, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.07% (0.3650 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3643 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.85% (0.3724 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5826 => 0.6022, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (0.5026 => 0.5194, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.14% (0.5889 => 0.6074, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.92% (1.6211 => 1.6684, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.85% (0.4029 => 0.4144, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7171 => 0.7370, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.77% (3.5627 => 3.6615, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.5900 => 0.6047, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (1.3152 => 1.3477, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (0.4994 => 0.5116, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.19% (0.9909 => 1.0126, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.10% (4.2109 => 4.2995, std. dev.: 0.0103) MultiSource/Applications/d/make_dparser: 1.77% (1.0781 => 1.0972, std. dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.69% (2.7292 => 2.7754, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.62% (23.5202 => 23.9024, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (4.4195 => 4.4907, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (1.9694 => 2.0001, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (1.9966 => 2.0249, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (1.8794 => 1.9060, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.30% (4.6177 => 4.6779, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (2.1013 => 2.1286, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (2.1653 => 2.1922, std. dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 1.23% (5.5417 => 5.6097, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 1.05% (1.5932 => 1.6099, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.41% (2.8036 => 2.8431, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.52% (11.9555 => 11.6545, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.20% (2.0820 => 2.0571, std. dev.: 0.0077) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 03:57:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 05:57:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623105729.180672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1414?compare_to=1411&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1414, Order: 159075, Start Time: 2012-06-23 10:00:57, End Time: 2012-06-23 10:58:59 To: 1411, Order: 159073, Start Time: 2012-06-23 08:37:14, End Time: 2012-06-23 09:34:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (745 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.19% (1.4083 => 1.3916, std. dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5818 => 0.6162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5748 => 0.6078, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.24% (0.7061 => 0.7431, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7710 => 0.8092, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2655 => 0.2785, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.80% (3.9660 => 4.1563, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 4.41% (0.2628 => 0.2744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5265 => 0.5494, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2760 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3489 => 0.3638, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3485 => 0.3628, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.6959 => 0.7231, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.80% (13.8202 => 14.3450, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4016 => 0.4167, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.2988 => 0.3097, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.54% (0.3534 => 0.3659, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.47% (1.0594 => 1.0962, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.44% (0.3868 => 0.4001, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.4563 => 1.5032, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 3.16% (0.3578 => 0.3691, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.2193 => 1.2575, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1718, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 3.02% (0.4003 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.01% (0.3789 => 0.3903, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 2.94% (0.3601 => 0.3707, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.91% (0.3646 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.89% (0.3663 => 0.3769, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.86% (16.6129 => 17.0884, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (3.8646 => 3.9742, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions-3: 2.82% (0.3623 => 0.3725, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 2.77% (0.3940 => 0.4049, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1359, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (13.2842 => 13.6402, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.3813 => 1.4181, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (3.6692 => 3.7662, std. dev.: 0.0080) MultiSource/Applications/treecc/treecc: 2.64% (1.9270 => 1.9778, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.59% (14.8535 => 15.2383, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1139, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4113 => 0.4214, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3869, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6135 => 0.6271, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.5754 => 6.7157, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2229, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (0.8698 => 0.8870, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.3801 => 4.4622, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.71% (3.1889 => 3.2435, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.70% (4.4433 => 4.5187, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.50% (1.2749 => 1.2940, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1333 => 1.1500, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.5298 => 14.7038, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.2742 => 3.3093, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 7.06% (1.2998 => 1.3916, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7260, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6049, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1481, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1924, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.25% (10.7476 => 10.8823, std. dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: 1.25% (4.5928 => 4.6500, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.94% (22.5627 => 20.9964, std. dev.: 0.3026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.24% (0.4366 => 0.4181, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std. dev.: 0.0554) MultiSource/Applications/minisat/minisat: -2.51% (9.3358 => 9.1016, std. dev.: 0.0340) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9739, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7797, std. dev.: 0.0598) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9859, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 04:06:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 06:06:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623110645.42C0B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1415?compare_to=1412&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1415, Order: 159075, Start Time: 2012-06-23 10:07:20, End Time: 2012-06-23 11:08:15 To: 1412, Order: 159073, Start Time: 2012-06-23 08:39:27, End Time: 2012-06-23 09:40:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (31 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.11% (0.3473 => 0.3720, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.92% (0.3497 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.88% (0.3516 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.86% (0.3543 => 0.3786, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 6.82% (0.3561 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 6.72% (10.3673 => 11.0635, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: 6.63% (0.3694 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.32% (0.3828 => 0.4070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.25% (0.3886 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.21% (0.3927 => 0.4171, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.6030 => 0.6232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5925 => 0.6117, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (7.0540 => 7.2738, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 2.51% (0.7326 => 0.7510, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7433 => 0.7603, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.20% (10.4361 => 10.6658, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.8172 => 0.8346, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.02% (21.9371 => 22.3803, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.91% (2.2022 => 2.2442, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.54% (5.7591 => 5.8479, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (9.4845 => 9.6166, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (4.9449 => 5.0108, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (8.1363 => 8.2445, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3188, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.21% (5.0018 => 5.0624, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.5415 => 1.5588, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.07% (3.3354 => 3.3710, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (2.0665 => 2.0879, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.29% (26.0924 => 26.6904, std. dev.: 0.0580) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.54% (0.8651 => 0.7307, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.42% (5.2763 => 4.8320, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (2.9384 => 2.7200, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.19% (1.1194 => 1.0501, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.06% (54.1659 => 51.4229, std. dev.: 0.0193) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.73% (6.6874 => 6.4381, std. dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: -3.11% (22.1758 => 21.4862, std. dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0920, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.13% (1.4460 => 1.4297, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 05:33:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 07:33:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623123311.A91B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1416?compare_to=1414&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1416, Order: 159076, Start Time: 2012-06-23 11:37:52, End Time: 2012-06-23 12:34:42 To: 1414, Order: 159075, Start Time: 2012-06-23 10:00:57, End Time: 2012-06-23 10:58:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2949, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.71% (0.5818 => 0.6150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5748 => 0.6061, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4328 => 0.4558, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.7061 => 0.7416, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.02% (1.3693 => 1.4380, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 4.97% (0.7038 => 0.7388, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.7710 => 0.8088, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 4.76% (0.2607 => 0.2731, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1522, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.59% (0.2726 => 0.2851, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.35% (0.2966 => 0.3095, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2760 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5265 => 0.5486, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (1.9828 => 2.0659, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3580 => 0.3729, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3453 => 0.3589, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.90% (0.3485 => 0.3621, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2761, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.81% (13.8202 => 14.3466, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2988 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3534 => 0.3652, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.33% (0.3578 => 0.3697, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.3868 => 0.3996, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0594 => 1.0939, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5036, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.2193 => 1.2571, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.10% (0.4003 => 0.4127, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.01% (0.3914 => 0.4032, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (1.1364 => 1.1706, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 2.93% (0.3646 => 0.3753, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 2.87% (0.3623 => 0.3727, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3622, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 2.77% (0.3940 => 0.4049, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.70% (3.8646 => 3.9690, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (13.2842 => 13.6426, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0570, std. dev.: 0.0067) MultiSource/Applications/Burg/burg: 2.61% (1.1061 => 1.1350, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.56% (3.6692 => 3.7632, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9752, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (7.2180 => 7.3974, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (1.3813 => 1.4153, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.45% (4.9865 => 5.1085, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.3819 => 1.4156, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2105, std. dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (6.5754 => 6.7222, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.88% (2.1791 => 2.2200, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8698 => 0.8861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.3801 => 4.4575, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.75% (3.1889 => 3.2446, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5152, std. dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2941, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (3.2742 => 3.3100, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.5298 => 14.6812, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7340, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8281, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6042, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.93% (7.9275 => 8.1598, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1921, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6538, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.85% (0.4657 => 0.3779, std. dev.: 0.0338) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9669, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3511 => 0.3376, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5776, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: -2.60% (9.3358 => 9.0929, std. dev.: 0.0362) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8876, std. dev.: 0.1079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5122, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7765, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9838, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2494, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.05% (7.3305 => 7.2535, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 05:38:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 07:38:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623123833.AEBF32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1417?compare_to=1415&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1417, Order: 159076, Start Time: 2012-06-23 11:39:22, End Time: 2012-06-23 12:40:02 To: 1415, Order: 159075, Start Time: 2012-06-23 10:07:20, End Time: 2012-06-23 11:08:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (11.0635 => 11.2389, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.41% (10.3673 => 11.2389, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3473 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.35% (0.3561 => 0.3787, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 6.32% (0.3497 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.31% (0.3516 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.27% (0.3543 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3543 => 0.3765, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3694 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3828 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.79% (0.3886 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.73% (0.3927 => 0.4152, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.02% (0.5925 => 0.6104, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.00% (0.6030 => 0.6211, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.66% (7.0540 => 7.2419, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: 2.24% (0.7326 => 0.7490, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.7433 => 0.7599, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.8172 => 0.8322, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.82% (2.2022 => 2.2423, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (10.4361 => 10.6237, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.77% (21.9371 => 22.3253, std. dev.: 0.0141) MultiSource/Applications/spiff/spiff: 1.31% (0.7835 => 0.7938, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.29% (5.7591 => 5.8332, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (4.2646 => 4.3156, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.9449 => 5.0029, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (8.1363 => 8.2285, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.5415 => 1.5587, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (9.4845 => 9.5830, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (5.0018 => 5.0525, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7646, std. dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.52% (0.8651 => 0.7308, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.41% (5.2763 => 4.8323, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.27% (2.9384 => 2.7247, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.21% (1.1194 => 1.0499, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -4.83% (54.1659 => 51.5488, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.65% (6.6874 => 6.4431, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -3.21% (22.1758 => 21.4638, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0932, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 06:06:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 08:06:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623130621.592512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1418?compare_to=1413&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1418, Order: 159075, Start Time: 2012-06-23 10:52:12, End Time: 2012-06-23 13:07:53 To: 1413, Order: 159072, Start Time: 2012-06-23 08:08:45, End Time: 2012-06-23 10:25:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (37 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.83% (21.6593 => 22.0563, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 30.72% (0.3792 => 0.4957, std. dev.: 0.0281) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.17% (0.3488 => 0.3773, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3446 => 0.3714, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3465 => 0.3733, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 7.70% (0.3442 => 0.3707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.69% (0.3460 => 0.3726, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3469 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3496 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.30% (0.3643 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.23% (0.3650 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.01% (0.3724 => 0.3985, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (0.5026 => 0.5206, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5826 => 0.6019, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.13% (0.4029 => 0.4155, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (1.6211 => 1.6714, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 3.09% (0.5889 => 0.6071, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (0.4994 => 0.5145, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.5900 => 0.6078, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.01% (3.5627 => 3.6699, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (1.3152 => 1.3513, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.49% (4.2109 => 4.3156, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.34% (0.5000 => 0.5117, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7171 => 0.7323, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 2.00% (1.5932 => 1.6251, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.97% (2.7292 => 2.7829, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (4.4195 => 4.5021, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0673 => 2.1045, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (1.9694 => 2.0040, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (2.1013 => 2.1377, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.63% (0.9909 => 1.0071, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.55% (4.6177 => 4.6894, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (1.9966 => 2.0272, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (2.1653 => 2.1976, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.49% (23.5202 => 23.8700, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (1.8794 => 1.9070, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 1.39% (5.5417 => 5.6190, std. dev.: 0.0164) MultiSource/Applications/lua/lua: 1.16% (1.4269 => 1.4434, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.56% (11.9555 => 11.6494, std. dev.: 0.0084) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 06:56:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 08:56:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623135655.E851D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1419?compare_to=1416&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1419, Order: 159079, Start Time: 2012-06-23 13:01:41, End Time: 2012-06-23 13:58:25 To: 1416, Order: 159076, Start Time: 2012-06-23 11:37:52, End Time: 2012-06-23 12:34:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (753 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (1.9464 => 1.9665, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (2.0176 => 2.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.24% (0.5818 => 0.6123, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.04% (0.4328 => 0.4546, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.98% (0.5748 => 0.6034, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.77% (1.3693 => 1.4346, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.7710 => 0.8075, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.67% (0.7061 => 0.7391, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.59% (3.9660 => 4.1480, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4062 => 0.4237, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.99% (0.2782 => 0.2893, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.98% (0.3899 => 0.4054, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.95% (0.2607 => 0.2710, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.88% (0.2781 => 0.2889, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2966 => 0.3081, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2765 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.79% (0.2690 => 0.2792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2760 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3489 => 0.3618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (1.9828 => 2.0555, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.66% (0.2761 => 0.2862, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.64% (0.2937 => 0.3044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3107 => 0.3218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.56% (0.3453 => 0.3576, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.54% (13.8202 => 14.3101, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.50% (0.3485 => 0.3607, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3149 => 0.3258, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4016 => 0.4155, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2292 => 1.2709, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.13% (0.3192 => 0.3292, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3293 => 0.3394, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.06% (0.3534 => 0.3642, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.4563 => 1.5004, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4390 => 0.4521, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2552, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9780, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0895, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.3245 => 1.3624, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 2.80% (0.7506 => 0.7716, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.79% (1.1061 => 1.1370, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.3868 => 0.3976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.65% (0.4003 => 0.4109, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.62% (1.9270 => 1.9775, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.3813 => 1.4169, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (1.3819 => 1.4142, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1930, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (3.6692 => 3.7504, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (13.2842 => 13.5690, std. dev.: 0.0071) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2255, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (7.2180 => 7.3608, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (6.5754 => 6.6940, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4527, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8698 => 0.8838, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.4433 => 4.5088, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.47% (3.1889 => 3.2358, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 26.94% (1.8175 => 2.3071, std. dev.: 0.0289) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.61% (1.2998 => 1.3857, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7322, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6034, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1343, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.5928 => 4.6524, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9879, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.11% (0.6576 => 0.6437, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1004, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6076, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9067, std. dev.: 0.0804) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7749, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9835, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.09% (7.3305 => 7.2506, std. dev.: 0.0200) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 07:06:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 09:06:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623140610.865222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1420?compare_to=1417&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1420, Order: 159079, Start Time: 2012-06-23 13:07:03, End Time: 2012-06-23 14:07:41 To: 1417, Order: 159076, Start Time: 2012-06-23 11:39:22, End Time: 2012-06-23 12:40:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (32 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (11.2389 => 11.0478, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.00% (0.3817 => 0.4466, std. dev.: 0.0210) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3543 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.92% (0.3497 => 0.3739, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.92% (0.3543 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3561 => 0.3806, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.69% (0.3694 => 0.3941, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 6.56% (10.3673 => 11.0478, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.37% (0.3927 => 0.4177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.28% (0.3886 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.6030 => 0.6262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.73% (0.5925 => 0.6146, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (7.0540 => 7.2424, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.8172 => 0.8350, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (10.4361 => 10.6374, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 1.86% (21.9371 => 22.3451, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 1.61% (0.7835 => 0.7961, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.47% (4.2646 => 4.3273, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0118, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.34% (2.2022 => 2.2318, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.20% (5.7591 => 5.8280, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (5.0018 => 5.0604, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (8.1363 => 8.2278, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.12% (9.4845 => 9.5906, std. dev.: 0.0078) MultiSource/Applications/d/make_dparser: 1.12% (3.3354 => 3.3727, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.08% (1.5415 => 1.5581, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.06% (2.0273 => 2.0487, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7533, std. dev.: 0.0321) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.55% (0.8651 => 0.7306, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7942, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.94% (2.9384 => 2.7051, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (1.1194 => 1.0481, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4584, std. dev.: 0.0347) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.81% (6.6874 => 6.4329, std. dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: -3.09% (22.1758 => 21.4910, std. dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.08% (1.7609 => 1.7418, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0915, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 08:20:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 10:20:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623152037.A84222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1421?compare_to=1419&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1421, Order: 159080, Start Time: 2012-06-23 14:25:22, End Time: 2012-06-23 15:22:08 To: 1419, Order: 159079, Start Time: 2012-06-23 13:01:41, End Time: 2012-06-23 13:58:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (753 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.97% (1.3857 => 1.4130, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.24% (2.0176 => 2.2847, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7038 => 0.7409, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.5818 => 0.6120, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5748 => 0.6039, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1986 => 0.2086, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (0.4328 => 0.4544, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.81% (1.3693 => 1.4351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.66% (0.7061 => 0.7390, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.7710 => 0.8063, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (3.9660 => 4.1472, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.28% (0.4062 => 0.4236, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5265 => 0.5484, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.13% (0.2782 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.6959 => 0.7244, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 3.99% (0.2607 => 0.2711, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.98% (0.3489 => 0.3628, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.3899 => 0.4051, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.88% (0.2781 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2966 => 0.3079, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.81% (0.2628 => 0.2728, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.79% (0.2690 => 0.2792, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.73% (13.8202 => 14.3356, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 3.69% (0.2761 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2726 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4016 => 0.4163, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2765 => 0.2866, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (1.9828 => 2.0552, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 3.61% (0.2937 => 0.3043, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.54% (0.3107 => 0.3217, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9199 => 0.9521, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 3.45% (0.3453 => 0.3572, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3485 => 0.3605, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.41% (1.2292 => 1.2711, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3149 => 0.3256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5049, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.13% (0.3192 => 0.3292, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (3.8646 => 3.9843, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2551, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0898, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1364 => 1.1689, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.84% (1.3245 => 1.3621, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.3868 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.75% (0.4003 => 0.4113, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.68% (1.9270 => 1.9786, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.65% (1.1061 => 1.1354, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1150, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.3813 => 1.4165, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.39% (1.3819 => 1.4149, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (3.6692 => 3.7510, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5756, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 2.17% (14.8535 => 15.1753, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.14% (2.1791 => 2.2257, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (7.2180 => 7.3638, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.5754 => 6.6960, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.3801 => 4.4575, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (1.2749 => 1.2959, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8698 => 0.8838, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5112, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.44% (3.1889 => 3.2348, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1465, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fbench: 24.82% (1.8175 => 2.2686, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/mandel-2: 8.71% (1.2998 => 1.4130, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7171, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6057, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1485, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9290 => 1.9562, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6550, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std. dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (22.5627 => 21.0067, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0974, std. dev.: 0.0171) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9278, std. dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2518, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7757, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9840, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2500, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 08:33:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 10:33:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623153341.C315B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1422?compare_to=1420&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1422, Order: 159080, Start Time: 2012-06-23 14:34:31, End Time: 2012-06-23 15:35:13 To: 1420, Order: 159079, Start Time: 2012-06-23 13:07:03, End Time: 2012-06-23 14:07:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.20% (0.3473 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3543 => 0.3790, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.92% (0.3543 => 0.3788, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3561 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.66% (0.3694 => 0.3940, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (10.3673 => 11.0493, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/exceptions: 6.50% (0.3828 => 0.4077, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.39% (0.3927 => 0.4178, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.6030 => 0.6262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.75% (0.5925 => 0.6147, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 2.81% (0.7326 => 0.7532, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.8172 => 0.8391, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7433 => 0.7629, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (7.0540 => 7.2310, std. dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 1.87% (21.9371 => 22.3480, std. dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 1.84% (10.4361 => 10.6278, std. dev.: 0.0108) MultiSource/Applications/spiff/spiff: 1.56% (0.7835 => 0.7957, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (4.2646 => 4.3252, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (1.5415 => 1.5625, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.34% (2.2022 => 2.2318, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.9449 => 5.0101, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (5.0018 => 5.0631, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.22% (3.3354 => 3.3762, std. dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 1.14% (5.7591 => 5.8250, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.1363 => 8.2267, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7771, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.56% (0.8651 => 0.7305, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.12% (5.2763 => 4.7952, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.97% (2.9384 => 2.7041, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (1.1194 => 1.0485, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4730, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.86% (6.6874 => 6.4296, std. dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: -3.12% (22.1758 => 21.4832, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.03% (1.7609 => 1.7428, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0926, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 08:48:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 10:48:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623154857.C17582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1423?compare_to=1418&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1423, Order: 159079, Start Time: 2012-06-23 13:34:43, End Time: 2012-06-23 15:50:27 To: 1418, Order: 159075, Start Time: 2012-06-23 10:52:12, End Time: 2012-06-23 13:07:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (23 on baseline) Performance Improvements: 10 (3 on baseline) Unchanged Tests: 884 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.75% (0.4957 => 0.4672, std. dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: -1.95% (1.6251 => 1.5934, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -1.27% (5.6190 => 5.5479, std. dev.: 0.0119) MultiSource/Applications/d/make_dparser: -1.24% (1.1012 => 1.0875, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.22% (1.4434 => 1.4258, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (2.7829 => 2.7495, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.13% (2.1377 => 2.1135, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: -1.08% (4.6894 => 4.6387, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -1.04% (4.3156 => 4.2706, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (1.3513 => 1.3377, std. dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.21% (0.3792 => 0.4672, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3488 => 0.3749, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.46% (0.3446 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.43% (0.3460 => 0.3717, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3465 => 0.3722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3442 => 0.3696, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3469 => 0.3722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.27% (0.3496 => 0.3750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3643 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.88% (0.3650 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.69% (0.3724 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5826 => 0.6045, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.60% (0.5889 => 0.6101, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.18% (0.7171 => 0.7399, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (0.5026 => 0.5166, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.41% (1.6211 => 1.6602, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.34% (0.5900 => 0.6038, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (3.5627 => 3.6377, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.71% (1.3152 => 1.3377, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.53% (2.0673 => 2.0989, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.45% (0.9909 => 1.0053, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.42% (4.2109 => 4.2706, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.13% (11.9555 => 11.5812, std. dev.: 0.0143) SingleSource/UnitTests/Vector/constpool: -2.32% (2.4764 => 2.4190, std. dev.: 0.0209) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (4.6926 => 4.6351, std. dev.: 0.0145) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 09:44:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 11:44:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623164413.7CF3D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1424?compare_to=1421&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1424, Order: 159081, Start Time: 2012-06-23 15:49:02, End Time: 2012-06-23 16:45:43 To: 1421, Order: 159080, Start Time: 2012-06-23 14:25:22, End Time: 2012-06-23 15:22:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (749 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2850, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (0.7038 => 0.7414, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.5818 => 0.6120, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (0.4328 => 0.4545, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.01% (0.5748 => 0.6036, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.7710 => 0.8094, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.75% (1.3693 => 1.4344, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.67% (0.7061 => 0.7391, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.61% (3.9660 => 4.1488, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4062 => 0.4245, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.11% (0.6959 => 0.7245, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2781 => 0.2892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.99% (0.2607 => 0.2711, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.91% (0.2966 => 0.3082, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.2937 => 0.3051, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.88% (0.2655 => 0.2758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2765 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2726 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2760 => 0.2865, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.79% (1.9828 => 2.0580, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 3.79% (0.2690 => 0.2792, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.70% (0.3107 => 0.3222, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3453 => 0.3580, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.66% (0.2761 => 0.2862, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.63% (13.8202 => 14.3213, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.4016 => 0.4160, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.2292 => 1.2722, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3485 => 0.3605, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3149 => 0.3257, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3756 => 0.3876, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.13% (0.3192 => 0.3292, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3534 => 0.3644, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.4563 => 1.5004, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9812, std. dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.01% (0.4390 => 0.4522, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2193 => 1.2556, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.0995, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/moments: 2.90% (0.3868 => 0.3980, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1364 => 1.1689, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.85% (0.7506 => 0.7720, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5577 => 0.5734, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.75% (1.9270 => 1.9800, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1358, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 2.67% (0.4003 => 0.4110, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3813 => 1.4175, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.54% (4.9865 => 5.1130, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (3.6692 => 3.7618, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.51% (1.3819 => 1.4166, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5877, std. dev.: 0.0145) MultiSource/Applications/siod/siod: 2.26% (2.1791 => 2.2283, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.14% (14.8535 => 15.1713, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.05% (7.2180 => 7.3660, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.5754 => 6.6973, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.8698 => 0.8844, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.3801 => 4.4517, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.4433 => 4.5121, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 1.46% (3.1889 => 3.2353, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1333 => 1.1468, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0489) SingleSource/Benchmarks/Misc/mandel-2: 8.92% (1.2998 => 1.4158, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7293, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6043, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.70% (7.9275 => 8.1415, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5115, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.5928 => 4.6534, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.26% (1.2308 => 1.2463, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std. dev.: 0.0164) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9927, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.87% (2.5089 => 2.4117, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5952, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.16% (9.3358 => 9.1340, std. dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9128, std. dev.: 0.0663) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.07% (6.6320 => 6.4949, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7784, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2528, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 10:01:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 12:01:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623170119.2D5052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1425?compare_to=1422&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1425, Order: 159082, Start Time: 2012-06-23 16:02:09, End Time: 2012-06-23 17:02:50 To: 1422, Order: 159080, Start Time: 2012-06-23 14:34:31, End Time: 2012-06-23 15:35:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.05% (0.3473 => 0.3718, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.95% (0.3497 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.92% (0.3543 => 0.3788, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3516 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.82% (0.3561 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.63% (0.3694 => 0.3939, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (10.3673 => 11.0448, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 6.32% (0.3828 => 0.4070, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.88% (0.6030 => 0.6264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5925 => 0.6148, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.8172 => 0.8420, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.81% (0.7326 => 0.7532, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (7.0540 => 7.2296, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.88% (21.9371 => 22.3503, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (10.4361 => 10.6270, std. dev.: 0.0101) MultiSource/Applications/spiff/spiff: 1.57% (0.7835 => 0.7958, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.41% (4.2646 => 4.3247, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (2.2022 => 2.2329, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.9449 => 5.0072, std. dev.: 0.0130) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (5.0018 => 5.0613, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.1363 => 8.2266, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.09% (3.3354 => 3.3716, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.07% (1.5415 => 1.5580, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.06% (5.7591 => 5.8203, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7805, std. dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.30% (0.8651 => 0.7327, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7941, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.07% (2.9384 => 2.7014, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0468, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4880, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.83% (6.6874 => 6.4312, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -3.12% (22.1758 => 21.4842, std. dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.10% (1.7609 => 1.7416, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0940, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.10% (1.4460 => 1.4301, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 11:07:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 13:07:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623180749.E5B7E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1426?compare_to=1424&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1426, Order: 159082, Start Time: 2012-06-23 17:12:41, End Time: 2012-06-23 18:09:20 To: 1424, Order: 159081, Start Time: 2012-06-23 15:49:02, End Time: 2012-06-23 16:45:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (757 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.26% (2.0176 => 2.2851, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.7038 => 0.7406, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 5.23% (0.5818 => 0.6122, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 4.98% (0.5748 => 0.6034, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.7710 => 0.8078, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 4.70% (1.3693 => 1.4336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.59% (0.7061 => 0.7385, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.58% (3.9660 => 4.1477, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.21% (0.4062 => 0.4233, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5265 => 0.5480, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.98% (0.3899 => 0.4054, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.97% (0.3022 => 0.3142, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.6959 => 0.7232, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.88% (0.2782 => 0.2890, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.85% (0.2781 => 0.2888, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2966 => 0.3079, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2655 => 0.2755, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.74% (0.3580 => 0.3714, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.73% (0.2765 => 0.2868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3489 => 0.3618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (1.9828 => 2.0555, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.62% (0.2761 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.61% (0.2937 => 0.3043, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.59% (13.8202 => 14.3158, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3149 => 0.3256, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3453 => 0.3570, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.39% (0.3485 => 0.3603, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3107 => 0.3212, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2707, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4016 => 0.4149, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3756 => 0.3872, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 2.97% (0.3534 => 0.3639, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4992, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (3.8646 => 3.9772, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2546, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.4390 => 0.4516, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.86% (16.6129 => 17.0873, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 2.84% (0.3868 => 0.3978, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1684, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.73% (1.1061 => 1.1363, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.73% (0.5577 => 0.5729, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.70% (0.7506 => 0.7709, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 2.67% (0.4003 => 0.4110, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.60% (1.9270 => 1.9771, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1138, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.3813 => 1.4160, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.46% (1.3819 => 1.4159, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (3.6692 => 3.7511, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5751, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.14% (2.1791 => 2.2257, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.10% (14.8535 => 15.1647, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (7.2180 => 7.3577, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (6.5754 => 6.6917, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.3801 => 4.4511, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8698 => 0.8838, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.45% (3.1889 => 3.2351, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (4.4433 => 4.5075, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2698, std. dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4063, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7362, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6045, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1395, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6546, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (1.9290 => 1.9508, std. dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2444, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.87% (0.4657 => 0.3825, std. dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9918, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3511 => 0.3385, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0147) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std. dev.: 0.0175) MultiSource/Applications/minisat/minisat: -2.46% (9.3358 => 9.1062, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.31% (20.3410 => 19.8713, std. dev.: 0.0500) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5027, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9847, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2531, std. dev.: 0.0230) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 11:31:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 13:31:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623183122.2565B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1427?compare_to=1423&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1427, Order: 159082, Start Time: 2012-06-23 16:17:21, End Time: 2012-06-23 18:32:54 To: 1423, Order: 159079, Start Time: 2012-06-23 13:34:43, End Time: 2012-06-23 15:50:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (25 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 893 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (2.0708 => 2.1051, std. dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.50% (0.3465 => 0.3725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.49% (0.3446 => 0.3704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3442 => 0.3697, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.41% (0.3469 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3460 => 0.3716, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3488 => 0.3746, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.32% (0.3496 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3643 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.71% (0.3724 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.86% (0.5826 => 0.6051, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.74% (0.5889 => 0.6109, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7171 => 0.7380, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (0.5026 => 0.5165, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.5900 => 0.6044, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (1.6211 => 1.6584, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (3.5627 => 3.6410, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (0.4994 => 0.5100, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.75% (4.2109 => 4.2845, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (1.3152 => 1.3380, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (2.0673 => 2.1001, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.57% (0.9909 => 1.0065, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (1.9694 => 1.9934, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (1.9966 => 2.0186, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (2.0820 => 2.1051, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.14% (11.9555 => 11.5804, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -1.71% (2.4764 => 2.4341, std. dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (4.6926 => 4.6396, std. dev.: 0.0038) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 13:11:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 15:11:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623201102.A06A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1428?compare_to=1426&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1428, Order: 159084, Start Time: 2012-06-23 19:15:41, End Time: 2012-06-23 20:12:32 To: 1426, Order: 159082, Start Time: 2012-06-23 17:12:41, End Time: 2012-06-23 18:09:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (745 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2837, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.43% (0.7038 => 0.7420, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.5818 => 0.6124, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.20% (0.4328 => 0.4553, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5748 => 0.6037, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.7710 => 0.8089, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7061 => 0.7400, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.80% (1.3693 => 1.4350, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.63% (0.3022 => 0.3162, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.60% (3.9660 => 4.1483, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 4.55% (0.4062 => 0.4247, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5265 => 0.5494, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.26% (0.2655 => 0.2768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2781 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.14% (0.2607 => 0.2715, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.6959 => 0.7246, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2765 => 0.2879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3580 => 0.3725, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.03% (1.9828 => 2.0627, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 3.99% (0.2760 => 0.2870, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.89% (0.3107 => 0.3228, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2726 => 0.2831, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2761 => 0.2867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.3149 => 0.3266, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.68% (13.8202 => 14.3287, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (0.3756 => 0.3887, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3534 => 0.3653, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3192 => 0.3299, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.4390 => 0.4527, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5014, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.08% (3.8646 => 3.9837, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 3.01% (16.6129 => 17.1122, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.2193 => 1.2559, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 2.95% (0.4003 => 0.4121, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.1364 => 1.1698, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.93% (0.7506 => 0.7726, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.90% (0.3868 => 0.3980, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.3245 => 1.3624, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.82% (1.9270 => 1.9814, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 2.82% (0.3578 => 0.3679, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.81% (1.1061 => 1.1372, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.74% (0.3650 => 0.3750, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 2.73% (0.3914 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.69% (0.3789 => 0.3891, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (4.9865 => 5.1187, std. dev.: 0.0278) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3813 => 1.4175, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3819 => 1.4176, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.54% (0.3940 => 0.4040, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0134) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2054, std. dev.: 0.1355) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (3.6692 => 3.7556, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.2842 => 13.5867, std. dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3701, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 1.87% (6.5754 => 6.6982, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4558, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.8698 => 0.8846, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.4433 => 4.5141, std. dev.: 0.0093) MultiSource/Applications/d/make_dparser: 1.56% (3.1889 => 3.2388, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.04% (0.9996 => 1.0800, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6962, std. dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6040, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1445, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.5928 => 4.6535, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.97% (22.5627 => 20.9908, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3511 => 0.3385, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0960, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6000, std. dev.: 0.0190) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9342, std. dev.: 0.0540) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7759, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9855, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (0.9692 => 0.9570, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2548, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 13:17:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 15:17:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623201715.779742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1429?compare_to=1425&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1429, Order: 159084, Start Time: 2012-06-23 19:18:10, End Time: 2012-06-23 20:18:47 To: 1425, Order: 159082, Start Time: 2012-06-23 16:02:09, End Time: 2012-06-23 17:02:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.61% (10.3673 => 11.0521, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 6.22% (0.3473 => 0.3689, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.12% (0.3543 => 0.3760, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.00% (0.3516 => 0.3727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3543 => 0.3755, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3561 => 0.3774, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 5.82% (0.3694 => 0.3909, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.3927 => 0.4149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.59% (0.3828 => 0.4042, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.79% (0.6030 => 0.6198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.62% (0.5925 => 0.6080, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (7.0540 => 7.2278, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.86% (21.9371 => 22.3445, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: 1.76% (0.7326 => 0.7455, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.76% (10.4361 => 10.6193, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: 1.52% (0.7835 => 0.7954, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.45% (4.2646 => 4.3264, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (2.2022 => 2.2297, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.9449 => 5.0042, std. dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 1.14% (5.7591 => 5.8246, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3725, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 1.10% (2.0273 => 2.0497, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.10% (1.5415 => 1.5585, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.0018 => 5.0567, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.1363 => 8.2211, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.41% (26.0924 => 26.7216, std. dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.96% (0.8651 => 0.7270, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7884, std. dev.: 0.0293) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (2.9384 => 2.7068, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (1.1194 => 1.0485, std. dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4903, std. dev.: 0.0310) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.89% (6.6874 => 6.4270, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4891, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7411, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0942, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 14:29:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 16:29:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120623212942.E7B4B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1430?compare_to=1427&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1430, Order: 159084, Start Time: 2012-06-23 19:15:45, End Time: 2012-06-23 21:31:15 To: 1427, Order: 159082, Start Time: 2012-06-23 16:17:21, End Time: 2012-06-23 18:32:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (24 on baseline) Performance Improvements: 1 (4 on baseline) Unchanged Tests: 891 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 7.36% (0.4496 => 0.4827, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.15% (2.8056 => 2.8379, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.91% (2.1051 => 2.0438, std. dev.: 0.0224) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 27.29% (0.3792 => 0.4827, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/exceptions-4: 6.67% (0.3465 => 0.3696, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.59% (0.3446 => 0.3673, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.51% (0.3488 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3442 => 0.3666, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 6.46% (0.3496 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.45% (0.3460 => 0.3683, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.43% (0.3469 => 0.3692, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 6.12% (0.3643 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.11% (0.3650 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.91% (0.3724 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.95% (0.5826 => 0.5998, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 2.72% (0.5889 => 0.6049, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.31% (0.7171 => 0.7337, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (1.6211 => 1.6546, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (0.5026 => 0.5127, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.5900 => 0.6011, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.77% (3.5627 => 3.6258, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.66% (1.3152 => 1.3370, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.36% (4.2109 => 4.2681, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (2.0673 => 2.0923, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.14% (0.9909 => 1.0022, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (1.9966 => 2.0176, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.22% (2.8036 => 2.8379, std. dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.32% (11.9555 => 11.5582, std. dev.: 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.47% (0.4253 => 0.4148, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.20% (2.4764 => 2.4220, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (4.6926 => 4.6384, std. dev.: 0.0027) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 14:46:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 16:46:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623214629.036D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1431?compare_to=1428&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1431, Order: 159086, Start Time: 2012-06-23 20:51:07, End Time: 2012-06-23 21:47:59 To: 1428, Order: 159084, Start Time: 2012-06-23 19:15:41, End Time: 2012-06-23 20:12:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (745 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.14% (0.4296 => 0.4075, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2849, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (0.7038 => 0.7422, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.5818 => 0.6120, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.08% (0.5748 => 0.6040, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.86% (1.3693 => 1.4359, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7061 => 0.7401, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.60% (3.9660 => 4.1483, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4062 => 0.4244, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.27% (0.3022 => 0.3151, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.14% (0.5265 => 0.5483, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 4.14% (0.2781 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.08% (0.3899 => 0.4058, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.6959 => 0.7242, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.01% (0.2690 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2655 => 0.2761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2765 => 0.2875, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.92% (1.9828 => 2.0606, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2761 => 0.2869, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2760 => 0.2867, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.73% (0.3107 => 0.3223, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.71% (0.2696 => 0.2796, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3246, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 3.65% (0.3453 => 0.3579, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.4016 => 0.4160, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.54% (1.2292 => 1.2727, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 3.15% (16.6129 => 17.1358, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.4563 => 1.5008, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (3.8646 => 3.9808, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.00% (0.3868 => 0.3984, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.2193 => 1.2554, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 2.90% (0.4003 => 0.4119, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (1.3245 => 1.3624, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 2.82% (0.7506 => 0.7718, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 2.74% (0.3789 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.73% (0.3914 => 0.4021, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.65% (1.9270 => 1.9780, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 2.64% (0.3940 => 0.4044, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.3819 => 1.4179, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1151, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (1.3813 => 1.4168, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (3.6692 => 3.7531, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (13.2842 => 13.5706, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.15% (14.8535 => 15.1728, std. dev.: 0.0063) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2252, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3683, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4650, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.5754 => 6.6968, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8698 => 0.8849, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.51% (3.1889 => 3.2370, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (4.4433 => 4.5098, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1333 => 1.1483, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2696, std. dev.: 0.0337) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4054, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7385, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (12.4560 => 12.9174, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6027, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1354, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.87% (10.7476 => 10.9483, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9558, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1968, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6529, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.50% (0.4657 => 0.4075, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9935, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4003, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5744, std. dev.: 0.0104) MultiSource/Applications/minisat/minisat: -2.60% (9.3358 => 9.0933, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.07% (6.6320 => 6.4947, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9476, std. dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7785, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9847, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.05% (7.3305 => 7.2534, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 14:50:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 16:50:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623215023.E35FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1432?compare_to=1429&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1432, Order: 159086, Start Time: 2012-06-23 20:51:17, End Time: 2012-06-23 21:51:55 To: 1429, Order: 159084, Start Time: 2012-06-23 19:18:10, End Time: 2012-06-23 20:18:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.63% (10.3673 => 11.0542, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 6.16% (0.3473 => 0.3687, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3543 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.98% (0.3543 => 0.3755, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3561 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.79% (0.3694 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.51% (0.3828 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3927 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.6030 => 0.6200, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7433 => 0.7631, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 2.60% (0.5925 => 0.6079, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.57% (0.8172 => 0.8382, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (7.0540 => 7.2254, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.84% (21.9371 => 22.3413, std. dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (10.4361 => 10.6220, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 1.76% (0.7326 => 0.7455, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.41% (4.2646 => 4.3246, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5630, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (2.2022 => 2.2304, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.23% (3.3354 => 3.3763, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.18% (4.9449 => 5.0033, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 1.16% (2.0273 => 2.0508, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 1.14% (5.7591 => 5.8246, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.1363 => 8.2209, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (5.0018 => 5.0534, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7731, std. dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.02% (0.8651 => 0.7265, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (5.2763 => 4.7907, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.89% (2.9384 => 2.7065, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.28% (1.1194 => 1.0491, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -4.87% (54.1659 => 51.5255, std. dev.: 0.0328) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.90% (6.6874 => 6.4264, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -3.11% (22.1758 => 21.4856, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.09% (1.7609 => 1.7417, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0933, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 16:10:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 18:10:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120623231029.7EB6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1433?compare_to=1431&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1433, Order: 159087, Start Time: 2012-06-23 22:14:57, End Time: 2012-06-23 23:12:00 To: 1431, Order: 159086, Start Time: 2012-06-23 20:51:07, End Time: 2012-06-23 21:47:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.59% (3.7728 => 3.8328, std. dev.: 0.0207) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2966, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (0.7038 => 0.7421, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.5818 => 0.6120, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4328 => 0.4552, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.7710 => 0.8105, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.01% (0.5748 => 0.6036, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.89% (1.3693 => 1.4363, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.84% (0.5265 => 0.5520, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7061 => 0.7402, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1503, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.4062 => 0.4239, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.33% (0.6959 => 0.7260, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.21% (0.3899 => 0.4063, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.20% (0.3022 => 0.3149, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.11% (0.2655 => 0.2764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2781 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3580 => 0.3725, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.01% (0.2966 => 0.3085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.99% (0.2760 => 0.2870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2726 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.92% (0.2937 => 0.3052, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (1.9828 => 2.0600, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.74% (0.3453 => 0.3582, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2761 => 0.2864, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.70% (0.3107 => 0.3222, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.65% (0.3149 => 0.3264, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2740, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.63% (13.8202 => 14.3218, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9199 => 0.9521, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3192 => 0.3299, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.34% (0.3293 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3756 => 0.3880, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4390 => 0.4531, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3868 => 0.3992, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (3.8646 => 3.9847, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5014, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2562, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1055, std. dev.: 0.0149) SingleSource/UnitTests/ObjC/parameter-passing: 2.92% (0.4003 => 0.4120, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.86% (0.7506 => 0.7721, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.76% (0.5577 => 0.5731, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 2.73% (0.3914 => 0.4021, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.73% (1.9270 => 1.9796, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.71% (1.1061 => 1.1361, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.68% (1.3813 => 1.4183, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 2.67% (0.3789 => 0.3890, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.60% (3.6692 => 3.7647, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/property: 2.59% (0.3940 => 0.4042, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1139, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.48% (1.3819 => 1.4162, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5781, std. dev.: 0.0149) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2273, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1783, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.6135 => 0.6267, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3679, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 1.82% (6.5754 => 6.6951, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.8698 => 0.8852, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4560, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5180, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (1.1333 => 1.1512, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.54% (3.1889 => 3.2380, std. dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2895, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.5298 => 14.6776, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0430) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7229, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8289, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6043, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.75% (7.9275 => 8.1459, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7731 => 3.8328, std. dev.: 0.0207) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6552, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0045, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.37% (0.9108 => 0.8983, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5962, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: -2.60% (9.3358 => 9.0935, std. dev.: 0.0332) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.17% (20.3410 => 19.8992, std. dev.: 0.0516) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7790, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4875, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2551, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 16:18:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 18:18:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120623231816.99E6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1434?compare_to=1432&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1434, Order: 159087, Start Time: 2012-06-23 22:18:49, End Time: 2012-06-23 23:19:48 To: 1432, Order: 159086, Start Time: 2012-06-23 20:51:17, End Time: 2012-06-23 21:51:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (10.3673 => 11.0493, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3473 => 0.3688, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.07% (0.3561 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.04% (0.3543 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.97% (0.3516 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.93% (0.3543 => 0.3753, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 5.85% (0.3694 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.55% (0.3927 => 0.4145, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.54% (0.3828 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.6030 => 0.6199, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.58% (0.5925 => 0.6078, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (7.0540 => 7.2284, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.86% (21.9371 => 22.3446, std. dev.: 0.0181) SingleSource/UnitTests/ObjC++/property-reference: 1.80% (0.7326 => 0.7458, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (10.4361 => 10.6210, std. dev.: 0.0147) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (0.8172 => 0.8309, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.39% (4.2646 => 4.3237, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.9449 => 5.0098, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8290, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (5.0018 => 5.0614, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.13% (1.5415 => 1.5589, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.06% (3.3354 => 3.3709, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.06% (2.0273 => 2.0488, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.1363 => 8.2209, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7643, std. dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.3045 => 1.3209, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.06% (0.8651 => 0.7262, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.21% (5.2763 => 4.7906, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.04% (2.9384 => 2.7021, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (1.1194 => 1.0490, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4971, std. dev.: 0.0884) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.94% (6.6874 => 6.4240, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4880, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7412, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0929, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4310, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 17:12:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 19:12:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624001203.337A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1435?compare_to=1430&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1435, Order: 159087, Start Time: 2012-06-23 21:58:05, End Time: 2012-06-24 00:13:34 To: 1430, Order: 159084, Start Time: 2012-06-23 19:15:45, End Time: 2012-06-23 21:31:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (21 on baseline) Performance Improvements: 1 (4 on baseline) Unchanged Tests: 892 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.2125 => 0.2253, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.19% (2.8379 => 2.8041, std. dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.65% (0.3446 => 0.3675, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3465 => 0.3693, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.57% (0.3442 => 0.3668, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.53% (0.3460 => 0.3686, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.49% (0.3469 => 0.3694, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.45% (0.3488 => 0.3713, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3496 => 0.3721, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.20% (0.3643 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.08% (0.3650 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.93% (0.3724 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.87% (0.5826 => 0.5993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.77% (0.5889 => 0.6052, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (0.5026 => 0.5145, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.19% (0.7171 => 0.7328, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (1.6211 => 1.6560, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.5900 => 0.6023, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (3.5627 => 3.6285, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (1.3152 => 1.3359, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.24% (4.2109 => 4.2631, std. dev.: 0.0156) MultiSource/Applications/hexxagon/hexxagon: 1.19% (0.9909 => 1.0027, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.24% (11.9555 => 11.5680, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.47% (0.4253 => 0.4148, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.17% (2.4764 => 2.4227, std. dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (4.6926 => 4.6396, std. dev.: 0.0057) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 17:33:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 19:33:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624003359.C5F3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1436?compare_to=1433&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1436, Order: 159090, Start Time: 2012-06-23 23:38:50, End Time: 2012-06-24 00:35:31 To: 1433, Order: 159087, Start Time: 2012-06-23 22:14:57, End Time: 2012-06-23 23:12:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (93 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (764 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.20% (2.0176 => 2.2840, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 4.92% (0.5818 => 0.6104, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (0.4328 => 0.4536, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.70% (1.3693 => 1.4337, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 4.65% (0.5748 => 0.6015, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.55% (3.9660 => 4.1464, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.39% (0.7061 => 0.7371, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5265 => 0.5484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.09% (0.4062 => 0.4228, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.71% (0.3022 => 0.3134, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.2781 => 0.2884, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.67% (0.3899 => 0.4042, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.56% (13.8202 => 14.3125, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2966 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.52% (0.3580 => 0.3706, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3489 => 0.3610, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.45% (1.9828 => 2.0512, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.39% (0.3485 => 0.3603, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3107 => 0.3211, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3453 => 0.3568, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4016 => 0.4149, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.30% (1.2292 => 1.2698, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 3.27% (0.3149 => 0.3252, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.0594 => 1.0930, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.4563 => 1.5006, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.2193 => 1.2550, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4390 => 0.4517, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.3756 => 0.3863, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.84% (1.1364 => 1.1687, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.83% (0.3534 => 0.3634, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9730, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (1.3245 => 1.3612, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.76% (0.5577 => 0.5731, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.3868 => 0.3972, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.64% (16.6129 => 17.0520, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (1.3819 => 1.4182, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.62% (1.1061 => 1.1351, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9766, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.54% (0.7506 => 0.7697, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.51% (1.3813 => 1.4160, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1114, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6112, std. dev.: 0.0276) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (3.6692 => 3.7565, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2032, std. dev.: 0.0188) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2243, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (6.5754 => 6.7090, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (7.2180 => 7.3612, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.3801 => 4.4537, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.61% (4.4433 => 4.5147, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.56% (3.1889 => 3.2386, std. dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.18% (2.0200 => 2.1853, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3988, std. dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.02% (11.2619 => 11.6019, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1387, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.5928 => 4.6535, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0046, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0975, std. dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6007, std. dev.: 0.0197) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9311, std. dev.: 0.0730) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7746, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.22% (0.9692 => 0.9574, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2526, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 17:45:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 19:45:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624004548.A67A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1437?compare_to=1434&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1437, Order: 159090, Start Time: 2012-06-23 23:46:44, End Time: 2012-06-24 00:47:20 To: 1434, Order: 159087, Start Time: 2012-06-23 22:18:49, End Time: 2012-06-23 23:19:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (29 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.84% (8.0220 => 8.1693, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.65% (22.3446 => 22.7122, std. dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.6507 => 28.0780, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -2.71% (32.4960 => 31.6142, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.98% (0.3543 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.96% (0.3543 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3561 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.95% (0.3497 => 0.3705, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.83% (10.3673 => 10.9719, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 5.71% (0.3694 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3828 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.40% (0.3927 => 0.4139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.38% (0.3886 => 0.4095, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 3.53% (21.9371 => 22.7122, std. dev.: 0.0182) SingleSource/UnitTests/ObjC++/Hello: 2.95% (0.5925 => 0.6100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.90% (0.6030 => 0.6205, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (10.4361 => 10.7238, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (7.0540 => 7.2427, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (7.9617 => 8.1693, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7433 => 0.7623, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 1.97% (0.7326 => 0.7470, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (9.4845 => 9.6518, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.8172 => 0.8307, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (2.2022 => 2.2334, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3187, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.9449 => 5.0056, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8256, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.10% (1.5415 => 1.5585, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (8.1363 => 8.2253, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7520, std. dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7969, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.40% (0.8651 => 0.7319, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (5.2763 => 4.7990, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (2.9384 => 2.6940, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.51% (1.1194 => 1.0465, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4308, std. dev.: 0.0376) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.95% (6.6874 => 6.4230, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -3.19% (22.1758 => 21.4690, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0926, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.76% (32.5116 => 31.6142, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 18:57:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 20:57:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624015731.BF6982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1438?compare_to=1436&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1438, Order: 159095, Start Time: 2012-06-24 01:02:18, End Time: 2012-06-24 01:59:02 To: 1436, Order: 159090, Start Time: 2012-06-23 23:38:50, End Time: 2012-06-24 00:35:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2857, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.5818 => 0.6181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.93% (0.5748 => 0.6089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7061 => 0.7448, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (0.7038 => 0.7412, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.86% (1.3693 => 1.4358, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (3.9660 => 4.1508, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 4.65% (0.4062 => 0.4251, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.50% (0.7710 => 0.8057, std. dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5265 => 0.5486, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2765 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2726 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.03% (0.2607 => 0.2712, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.01% (0.2690 => 0.2798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.94% (0.2966 => 0.3083, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3580 => 0.3721, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (1.9828 => 2.0604, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2761 => 0.2869, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.3899 => 0.4051, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.85% (0.2937 => 0.3050, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.81% (0.2628 => 0.2728, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.6959 => 0.7223, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.76% (13.8202 => 14.3397, std. dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: 3.74% (1.2292 => 1.2752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4016 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.35% (0.3578 => 0.3698, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (0.3293 => 0.3400, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.4563 => 1.5035, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3868 => 0.3992, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.17% (0.3534 => 0.3646, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 3.14% (0.3789 => 0.3908, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4390 => 0.4525, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1709, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 3.03% (0.3663 => 0.3774, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 3.02% (0.3646 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.01% (0.3650 => 0.3760, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3245 => 1.3644, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 2.99% (0.3914 => 0.4031, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 2.98% (0.3623 => 0.3731, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.86% (16.6129 => 17.0887, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9735, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5577 => 0.5734, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.66% (1.9270 => 1.9782, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (4.9865 => 5.1189, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 2.60% (0.7506 => 0.7701, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (0.7460 => 0.7649, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2191, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (3.6692 => 3.7591, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6017, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (7.2180 => 7.3825, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.27% (1.3819 => 1.4133, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.5754 => 6.7156, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.96% (2.1791 => 2.2218, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.3801 => 4.4609, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.8698 => 0.8857, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2456, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.4433 => 4.5185, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2956, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1491, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (8.4961 => 8.5925, std. dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: 1.12% (14.5298 => 14.6923, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.86% (7.4271 => 7.7137, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 3.58% (1.9144 => 1.9830, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8318, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6033, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1332, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.5928 => 4.6534, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.12% (0.4657 => 0.3953, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9847, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5927, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1044, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9766, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7763, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9848, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2529, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 19:13:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 21:13:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624021317.C32EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1439?compare_to=1437&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1439, Order: 159095, Start Time: 2012-06-24 01:14:12, End Time: 2012-06-24 02:14:49 To: 1437, Order: 159090, Start Time: 2012-06-23 23:46:44, End Time: 2012-06-24 00:47:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (835 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3473 => 0.3688, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.96% (0.3543 => 0.3754, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.93% (0.3543 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.77% (0.3694 => 0.3907, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.55% (10.3673 => 10.9422, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/parameter-passing: 5.45% (0.3927 => 0.4141, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.41% (0.3828 => 0.4035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.38% (0.3886 => 0.4095, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 3.45% (21.9371 => 22.6944, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 2.84% (0.5925 => 0.6093, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.75% (0.6030 => 0.6196, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (10.4361 => 10.7190, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (7.9617 => 8.1613, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 2.41% (0.7433 => 0.7612, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (7.0540 => 7.2232, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.06% (0.7326 => 0.7477, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (9.4845 => 9.6449, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.16% (1.5415 => 1.5594, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (8.1363 => 8.2293, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.9449 => 5.0002, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (4.2646 => 4.3119, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (2.2022 => 2.2255, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7543, std. dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7952, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.27% (0.8651 => 0.7330, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.89% (5.2763 => 4.8072, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.08% (2.9384 => 2.7011, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.26% (1.1194 => 1.0493, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4343, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.64% (6.6874 => 6.4438, std. dev.: 0.0319) MultiSource/Applications/ClamAV/clamscan: -3.06% (22.1758 => 21.4968, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0917, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6072, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 20:19:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 22:19:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624031907.A98A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1440?compare_to=1435&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1440, Order: 159095, Start Time: 2012-06-24 01:05:12, End Time: 2012-06-24 03:20:39 To: 1435, Order: 159087, Start Time: 2012-06-23 21:58:05, End Time: 2012-06-24 00:13:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (21 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 893 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -4.62% (0.2253 => 0.2149, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.06% (0.3465 => 0.3675, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.04% (0.3446 => 0.3654, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.99% (0.3488 => 0.3697, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.98% (0.3460 => 0.3667, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.95% (0.3496 => 0.3704, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.94% (0.3469 => 0.3675, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3442 => 0.3646, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.74% (0.3643 => 0.3852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.70% (0.3650 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.53% (0.3724 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.97% (0.5826 => 0.5999, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (0.5026 => 0.5173, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 2.55% (0.5889 => 0.6039, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (1.6211 => 1.6620, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.46% (0.5900 => 0.6045, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.10% (3.5627 => 3.6375, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 2.09% (0.7171 => 0.7321, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (1.3152 => 1.3382, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.74% (4.2109 => 4.2840, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (1.9966 => 2.0198, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (4.4195 => 4.4681, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.14% (11.9555 => 11.5804, std. dev.: 0.0080) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 20:20:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 22:20:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624032055.CC0392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1441?compare_to=1438&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1441, Order: 159096, Start Time: 2012-06-24 02:25:45, End Time: 2012-06-24 03:22:27 To: 1438, Order: 159095, Start Time: 2012-06-24 01:02:18, End Time: 2012-06-24 01:59:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.12% (2.0176 => 2.3024, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.55% (0.5818 => 0.6199, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.32% (0.5748 => 0.6111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.82% (0.7061 => 0.7472, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.39% (0.7038 => 0.7417, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.94% (1.3693 => 1.4370, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1576, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.81% (0.2726 => 0.2857, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.75% (0.2760 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.7710 => 0.8063, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.47% (1.9828 => 2.0715, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3489 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2292 => 1.2797, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.95% (0.6959 => 0.7234, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3192 => 0.3317, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3564, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3868 => 0.4008, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.4563 => 1.5075, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 3.44% (0.3578 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.40% (0.3789 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.37% (0.4003 => 0.4138, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 3.32% (0.3646 => 0.3767, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions-2: 3.28% (0.3601 => 0.3719, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.3914 => 0.4042, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.23% (0.3650 => 0.3768, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 3.22% (0.3663 => 0.3781, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.15% (0.3940 => 0.4064, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.09% (1.2193 => 1.2570, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-3: 3.09% (0.3623 => 0.3735, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.02% (16.6129 => 17.1140, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (3.8646 => 3.9782, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 2.74% (0.7506 => 0.7712, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.68% (1.9270 => 1.9787, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.9865 => 5.1197, std. dev.: 0.0123) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (3.6692 => 3.7612, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4156, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2208, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6135 => 0.6281, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.5999, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.3819 => 1.4137, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.7460 => 0.7630, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.23% (7.2180 => 7.3788, std. dev.: 0.0121) MultiSource/Applications/siod/siod: 2.19% (2.1791 => 2.2268, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.5754 => 6.7096, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8698 => 0.8871, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.3801 => 4.4603, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5243, std. dev.: 0.0066) MultiSource/Applications/d/make_dparser: 1.60% (3.1889 => 3.2399, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.36% (1.1333 => 1.1487, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3094, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2715, std. dev.: 0.0435) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9996 => 1.0799, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7316, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6056, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.72% (7.9275 => 8.1428, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.5928 => 4.6524, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2308 => 1.2445, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0019, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5873, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/health/health: -2.51% (0.4533 => 0.4419, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1043, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9581, std. dev.: 0.0620) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7758, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.30% (3.0263 => 2.9869, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2609, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -1.01% (7.3305 => 7.2563, std. dev.: 0.0170) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 20:40:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 23 Jun 2012 22:40:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624034044.9DCDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1442?compare_to=1439&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1442, Order: 159096, Start Time: 2012-06-24 02:41:40, End Time: 2012-06-24 03:42:17 To: 1439, Order: 159095, Start Time: 2012-06-24 01:14:12, End Time: 2012-06-24 02:14:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (33 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.02% (0.3473 => 0.3682, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.90% (0.3543 => 0.3752, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.87% (0.3543 => 0.3751, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3561 => 0.3770, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 5.86% (0.3516 => 0.3722, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.68% (0.3694 => 0.3904, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 5.43% (0.3828 => 0.4036, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.37% (0.3927 => 0.4138, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 5.33% (0.3886 => 0.4093, std. dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 5.24% (10.3673 => 10.9102, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 3.59% (21.9371 => 22.7251, std. dev.: 0.0172) SingleSource/UnitTests/ObjC++/property-reference-object: 3.52% (0.6030 => 0.6242, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 2.99% (0.5925 => 0.6102, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (10.4361 => 10.7352, std. dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (7.9617 => 8.1718, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (7.0540 => 7.2352, std. dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7326 => 0.7509, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.49% (0.7433 => 0.7618, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.8172 => 0.8322, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (9.4845 => 9.6535, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.35% (5.7591 => 5.8369, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (8.1363 => 8.2415, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3007, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.28% (4.2646 => 4.3193, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.24% (2.2022 => 2.2296, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.21% (1.5415 => 1.5601, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.9449 => 5.0043, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 1.13% (3.3354 => 3.3731, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (5.0018 => 5.0571, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7823, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7956, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.20% (0.8651 => 0.7336, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.01% (5.2763 => 4.8011, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.16% (2.9384 => 2.6985, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0476, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.08% (54.1659 => 51.4124, std. dev.: 0.0189) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.82% (6.6874 => 6.4317, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -2.98% (22.1758 => 21.5143, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.01% (1.7609 => 1.7432, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0928, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.76% (32.5116 => 31.6138, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 22:21:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 00:21:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624052159.C24512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1443?compare_to=1441&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1443, Order: 159103, Start Time: 2012-06-24 04:26:48, End Time: 2012-06-24 05:23:30 To: 1441, Order: 159096, Start Time: 2012-06-24 02:25:45, End Time: 2012-06-24 03:22:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.07% (2.0176 => 2.3015, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 6.53% (0.5818 => 0.6198, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5748 => 0.6105, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7061 => 0.7462, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (0.7038 => 0.7414, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.7710 => 0.8089, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.80% (0.4062 => 0.4257, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (3.9660 => 4.1525, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.3899 => 0.4071, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.2937 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3489 => 0.3641, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (1.9828 => 2.0691, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.79% (13.8202 => 14.3440, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3756 => 0.3894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 3.44% (0.3578 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.40% (0.3789 => 0.3918, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 3.37% (0.3646 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.30% (0.4003 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.28% (0.3601 => 0.3719, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.28% (0.3663 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (1.4563 => 1.5026, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.07% (0.3650 => 0.3762, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.06% (0.3623 => 0.3734, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.06% (1.2193 => 1.2566, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3245 => 1.3641, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9778, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.92% (16.6129 => 17.0987, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1693, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.70% (0.7506 => 0.7709, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.70% (1.9270 => 1.9790, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1165, std. dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3819 => 1.4176, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.2842 => 13.6078, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (3.6692 => 3.7577, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2084, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3814, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2267, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (6.5754 => 6.7159, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8698 => 0.8864, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4624, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (4.4433 => 4.5251, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2393, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 27.58% (1.8175 => 2.3188, std. dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1897, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7227, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.06% (11.2619 => 11.6067, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1303, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6547, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.29% (0.4657 => 0.4178, std. dev.: 0.0181) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9919, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.67% (9.3358 => 9.0864, std. dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5983, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4971, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9753, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7757, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.39% (3.0263 => 2.9842, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2515, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 22:29:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 00:29:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624052918.53F0B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1444?compare_to=1442&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1444, Order: 159103, Start Time: 2012-06-24 04:30:16, End Time: 2012-06-24 05:30:50 To: 1442, Order: 159096, Start Time: 2012-06-24 02:41:40, End Time: 2012-06-24 03:42:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (10.9102 => 11.1507, std. dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.56% (10.3673 => 11.1507, std. dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3473 => 0.3688, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.96% (0.3543 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.89% (0.3516 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3543 => 0.3750, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.78% (0.3561 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3694 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3828 => 0.4038, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.42% (0.3927 => 0.4140, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.28% (0.3886 => 0.4091, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.61% (21.9371 => 22.7285, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.24% (7.0540 => 7.2828, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (10.4361 => 10.7654, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 2.99% (0.5925 => 0.6102, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.71% (7.9617 => 8.1778, std. dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference-object: 2.59% (0.6030 => 0.6186, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 2.45% (0.7433 => 0.7615, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 2.14% (0.7326 => 0.7483, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (0.8172 => 0.8324, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (2.2022 => 2.2420, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (9.4845 => 9.6548, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1363 => 8.2423, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.29% (0.7835 => 0.7936, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.2646 => 4.3154, std. dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 1.19% (5.7591 => 5.8274, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.9449 => 5.0008, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7735, std. dev.: 0.0247) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7956, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3180, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.71% (0.8651 => 0.7292, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7940, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.41% (2.9384 => 2.6914, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.62% (1.1194 => 1.0453, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3221, std. dev.: 0.0314) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (6.6874 => 6.4208, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: -3.19% (22.1758 => 21.4690, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0923, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.76% (32.5116 => 31.6150, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.10% (1.4460 => 1.4301, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 23:01:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 01:01:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624060116.AEE302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1445?compare_to=1440&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1445, Order: 159096, Start Time: 2012-06-24 03:47:25, End Time: 2012-06-24 06:02:48 To: 1440, Order: 159095, Start Time: 2012-06-24 01:05:12, End Time: 2012-06-24 03:20:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (22 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.14% (0.3792 => 0.4480, std. dev.: 0.0213) SingleSource/UnitTests/ObjC/exceptions-2: 6.41% (0.3446 => 0.3667, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.38% (0.3465 => 0.3686, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.30% (0.3460 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.29% (0.3496 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.28% (0.3488 => 0.3707, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.25% (0.3442 => 0.3657, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.3469 => 0.3684, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.08% (0.3650 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.01% (0.3643 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.3724 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.52% (0.5826 => 0.6031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.09% (0.5889 => 0.6071, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (0.5026 => 0.5164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7171 => 0.7354, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.36% (1.6211 => 1.6593, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.5900 => 0.6019, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (3.5627 => 3.6310, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 1.71% (4.2109 => 4.2830, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (1.3152 => 1.3372, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (2.0673 => 2.0943, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.02% (1.9694 => 1.9895, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.92% (11.9555 => 11.6063, std. dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -2.40% (2.4764 => 2.4169, std. dev.: 0.0150) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 23:45:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 01:45:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624064526.1B6C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1446?compare_to=1443&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1446, Order: 159104, Start Time: 2012-06-24 05:50:18, End Time: 2012-06-24 06:46:57 To: 1443, Order: 159103, Start Time: 2012-06-24 04:26:48, End Time: 2012-06-24 05:23:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 2 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (745 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.4178 => 0.3962, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.31% (2.3188 => 2.2653, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.12% (2.0176 => 2.3025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.48% (0.5818 => 0.6195, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5748 => 0.6112, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7061 => 0.7462, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.43% (0.7038 => 0.7420, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.4062 => 0.4258, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2765 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.75% (0.2760 => 0.2891, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.74% (3.9660 => 4.1538, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.7710 => 0.8059, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (1.9828 => 2.0706, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.35% (0.2761 => 0.2881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.16% (0.4016 => 0.4183, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.02% (0.2988 => 0.3108, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.00% (1.2292 => 1.2784, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3192 => 0.3317, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.89% (13.8202 => 14.3578, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9199 => 0.9526, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 3.38% (0.3578 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.37% (0.4003 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.35% (0.3789 => 0.3916, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.0594 => 1.0948, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.4563 => 1.5038, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 3.22% (0.3601 => 0.3717, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.22% (0.3914 => 0.4040, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.09% (16.6129 => 17.1257, std. dev.: 0.0120) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.07% (0.3650 => 0.3762, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.05% (1.2193 => 1.2565, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.04% (0.3623 => 0.3733, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (3.8646 => 3.9758, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1684, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.69% (1.9270 => 1.9789, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1358, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.66% (0.7506 => 0.7706, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (4.9865 => 5.1191, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (3.6692 => 3.7634, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2159, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5945, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (1.3813 => 1.4134, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4135, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6135 => 0.6271, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.19% (2.1791 => 2.2268, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (7.2180 => 7.3747, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.05% (6.5754 => 6.7100, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.3801 => 4.4597, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5155, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2393, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.36% (0.9996 => 1.0832, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.35% (1.2998 => 1.4083, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7145, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6034, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1400, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6531, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.92% (0.4657 => 0.3962, std. dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9990, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4113, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5817, std. dev.: 0.0163) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1010, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9559, std. dev.: 0.0160) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.75% (6.6320 => 6.5161, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7753, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9836, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2517, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 23 23:56:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 01:56:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624065654.3B4152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1447?compare_to=1444&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1447, Order: 159104, Start Time: 2012-06-24 05:57:48, End Time: 2012-06-24 06:58:25 To: 1444, Order: 159103, Start Time: 2012-06-24 04:30:16, End Time: 2012-06-24 05:30:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (28 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.11% (7.9604 => 8.0488, std. dev.: 0.0220) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.62% (10.3673 => 11.1574, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 5.99% (0.3473 => 0.3681, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.93% (0.3543 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3516 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.68% (0.3694 => 0.3904, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 5.38% (0.3828 => 0.4034, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.33% (0.3886 => 0.4093, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.30% (0.3927 => 0.4135, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.62% (21.9371 => 22.7307, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.06% (7.0540 => 7.2695, std. dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (10.4361 => 10.7534, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 2.89% (0.5925 => 0.6096, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.73% (7.9617 => 8.1794, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7433 => 0.7616, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7326 => 0.7481, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.8172 => 0.8327, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.79% (2.2022 => 2.2417, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (9.4845 => 9.6509, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (8.1363 => 8.2431, std. dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 1.25% (5.7591 => 5.8309, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.9449 => 5.0005, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.0018 => 5.0567, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7920, std. dev.: 0.0308) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7953, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3180, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.61% (0.8651 => 0.7301, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.21% (5.2763 => 4.7903, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.39% (2.9384 => 2.6920, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.68% (1.1194 => 1.0446, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3205, std. dev.: 0.0216) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.97% (6.6874 => 6.4218, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: -3.21% (22.1758 => 21.4644, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.03% (1.7609 => 1.7428, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0933, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6065, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4300, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 01:13:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 03:13:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624081318.9236F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1448?compare_to=1446&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1448, Order: 159107, Start Time: 2012-06-24 07:17:41, End Time: 2012-06-24 08:14:49 To: 1446, Order: 159104, Start Time: 2012-06-24 05:50:18, End Time: 2012-06-24 06:46:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3023, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5818 => 0.6179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.05% (0.5748 => 0.6096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7061 => 0.7460, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (0.7038 => 0.7422, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.01% (1.3693 => 1.4379, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (3.9660 => 4.1573, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3022 => 0.3166, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.7710 => 0.8072, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 4.60% (0.2607 => 0.2727, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.42% (1.9828 => 2.0704, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.41% (0.5265 => 0.5497, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.35% (0.2761 => 0.2881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.20% (0.6959 => 0.7251, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3489 => 0.3634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.92% (13.8202 => 14.3620, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3756 => 0.3894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.59% (0.3534 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0594 => 1.0956, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.36% (0.3868 => 0.3998, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.4563 => 1.5045, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.26% (16.6129 => 17.1538, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (3.8646 => 3.9897, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 3.21% (0.3578 => 0.3693, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.17% (1.1364 => 1.1724, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 3.14% (0.3914 => 0.4037, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2574, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.06% (0.3789 => 0.3905, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.99% (0.3650 => 0.3759, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 2.97% (0.3601 => 0.3708, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 2.96% (0.3646 => 0.3754, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.95% (1.3813 => 1.4220, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 2.94% (0.3940 => 0.4056, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 2.87% (0.3663 => 0.3768, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.85% (0.7506 => 0.7720, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.84% (1.1061 => 1.1375, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 2.82% (1.9270 => 1.9813, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.3819 => 1.4184, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (13.2842 => 13.6332, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (3.6692 => 3.7592, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.45% (14.8535 => 15.2175, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7460 => 0.7642, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2312, std. dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.35% (0.4379 => 0.4482, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.23% (7.2180 => 7.3792, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7131, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.3801 => 4.4606, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2436, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.4433 => 4.5169, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1333 => 1.1500, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.5298 => 14.6785, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.00% (0.9996 => 1.0796, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 6.73% (1.2998 => 1.3873, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7259, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6035, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.87% (7.9275 => 8.1551, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.5928 => 4.6535, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2308 => 1.2462, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.88% (22.5627 => 21.0109, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5861, std. dev.: 0.0109) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0961, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.09% (6.6320 => 6.4932, std. dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9803, std. dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7754, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2597, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9852, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2516, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 01:28:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 03:28:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624082843.2D8C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1449?compare_to=1447&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1449, Order: 159107, Start Time: 2012-06-24 07:29:10, End Time: 2012-06-24 08:30:15 To: 1447, Order: 159104, Start Time: 2012-06-24 05:57:48, End Time: 2012-06-24 06:58:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (32 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.38% (10.3673 => 11.2360, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 5.99% (0.3473 => 0.3681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.87% (0.3543 => 0.3751, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3497 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3543 => 0.3749, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 5.78% (0.3561 => 0.3767, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3516 => 0.3719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.66% (0.3694 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3927 => 0.4143, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: 5.41% (0.3828 => 0.4035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.38% (0.3886 => 0.4095, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.76% (21.9371 => 22.7629, std. dev.: 0.0325) MultiSource/Applications/JM/ldecod/ldecod: 3.38% (10.4361 => 10.7885, std. dev.: 0.0185) SingleSource/UnitTests/ObjC++/property-reference-object: 3.10% (0.6030 => 0.6217, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.03% (7.9617 => 8.2027, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (7.0540 => 7.2674, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/Hello: 3.02% (0.5925 => 0.6104, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.91% (0.7433 => 0.7649, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (9.4845 => 9.6794, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.1363 => 8.2714, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (2.2022 => 2.2342, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (4.2646 => 4.3258, std. dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: 1.36% (5.7591 => 5.8373, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.9449 => 5.0072, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (5.0018 => 5.0643, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3735, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.09% (2.0273 => 2.0494, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.06% (1.5415 => 1.5578, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7548, std. dev.: 0.0296) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.24% (0.8651 => 0.7333, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.90% (5.2763 => 4.8068, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.05% (2.9384 => 2.7020, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.31% (1.1194 => 1.0488, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4321, std. dev.: 0.0351) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.72% (6.6874 => 6.4388, std. dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: -2.96% (22.1758 => 21.5202, std. dev.: 0.0550) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0924, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6122, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 02:02:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 04:02:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624090243.34B8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1450?compare_to=1445&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1450, Order: 159107, Start Time: 2012-06-24 06:46:47, End Time: 2012-06-24 09:04:15 To: 1445, Order: 159096, Start Time: 2012-06-24 03:47:25, End Time: 2012-06-24 06:02:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (23 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 892 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.73% (0.2163 => 0.2287, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.20% (2.8073 => 2.8409, std. dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.39% (0.3488 => 0.3711, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3446 => 0.3666, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.38% (0.3465 => 0.3686, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.33% (0.3460 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.21% (0.3496 => 0.3713, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.3469 => 0.3684, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3442 => 0.3655, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.01% (0.3643 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.81% (0.3650 => 0.3862, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.77% (0.3724 => 0.3939, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 3.45% (0.5826 => 0.6027, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.14% (0.5889 => 0.6074, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7171 => 0.7394, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (1.6211 => 1.6588, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (0.4994 => 0.5110, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.5900 => 0.6027, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.00% (3.5627 => 3.6340, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.95% (1.3152 => 1.3408, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 1.73% (4.2109 => 4.2839, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (2.0673 => 2.0918, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (1.9694 => 1.9912, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.78% (0.2162 => 0.2287, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.33% (2.8036 => 2.8409, std. dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.25% (2.4764 => 2.3960, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -2.93% (11.9555 => 11.6058, std. dev.: 0.0161) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 02:37:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 04:37:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624093706.C0E182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1451?compare_to=1448&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1451, Order: 159109, Start Time: 2012-06-24 08:41:47, End Time: 2012-06-24 09:38:38 To: 1448, Order: 159107, Start Time: 2012-06-24 07:17:41, End Time: 2012-06-24 08:14:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.97% (2.0176 => 2.2994, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.5818 => 0.6181, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.02% (0.5748 => 0.6094, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7061 => 0.7441, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 5.21% (0.7038 => 0.7405, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.09% (1.3693 => 1.4390, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.7710 => 0.8085, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.4062 => 0.4258, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.74% (3.9660 => 4.1541, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.53% (0.3022 => 0.3159, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.2781 => 0.2907, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2761 => 0.2879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.23% (1.9828 => 2.0666, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.18% (0.3899 => 0.4062, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.11% (0.6959 => 0.7245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2628 => 0.2736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.06% (0.3107 => 0.3233, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.91% (13.8202 => 14.3605, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.88% (1.2292 => 1.2769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4016 => 0.4168, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.65% (0.9199 => 0.9535, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5069, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.38% (1.0594 => 1.0952, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.3868 => 0.3996, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4390 => 0.4533, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.18% (0.3646 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.11% (0.3601 => 0.3713, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.11% (16.6129 => 17.1291, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.09% (1.2193 => 1.2570, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.09% (0.3914 => 0.4035, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.99% (0.3650 => 0.3759, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1702, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5577 => 0.5742, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.95% (3.8646 => 3.9787, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 2.93% (0.3623 => 0.3729, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.81% (1.9270 => 1.9812, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1368, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.9865 => 5.1197, std. dev.: 0.0205) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (13.2842 => 13.6287, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7596, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4151, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.38% (7.2180 => 7.3899, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.6135 => 0.6280, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.32% (14.8535 => 15.1979, std. dev.: 0.0175) MultiSource/Applications/siod/siod: 2.27% (2.1791 => 2.2286, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.8698 => 0.8881, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (6.5754 => 6.7086, std. dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.3801 => 4.4568, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2436, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5167, std. dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2749 => 1.2943, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1333 => 1.1489, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6905, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 26.39% (1.8175 => 2.2972, std. dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.60% (2.0200 => 2.1938, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 8.20% (1.2998 => 1.4064, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7252, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6028, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.76% (7.9275 => 8.1464, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9546, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.5928 => 4.6518, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.2308 => 1.2457, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8558, std. dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9868, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5865, std. dev.: 0.0206) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1006, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5011, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9554, std. dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7761, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9853, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2552, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 02:56:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 04:56:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624095637.37D3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1452?compare_to=1449&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1452, Order: 159109, Start Time: 2012-06-24 08:57:29, End Time: 2012-06-24 09:58:09 To: 1449, Order: 159107, Start Time: 2012-06-24 07:29:10, End Time: 2012-06-24 08:30:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (33 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 9.20% (10.3673 => 11.3213, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.04% (0.3543 => 0.3757, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3473 => 0.3672, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 5.60% (0.3497 => 0.3693, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.53% (0.3543 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.49% (0.3516 => 0.3709, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.45% (0.3561 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.39% (0.3694 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.10% (0.3886 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.07% (0.3828 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.07% (0.3927 => 0.4126, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.69% (21.9371 => 22.7461, std. dev.: 0.0165) MultiSource/Applications/JM/ldecod/ldecod: 3.28% (10.4361 => 10.7784, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (7.0540 => 7.2684, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.78% (7.9617 => 8.1834, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (0.7433 => 0.7628, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 2.53% (0.5925 => 0.6075, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.6030 => 0.6170, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (9.4845 => 9.6685, std. dev.: 0.0155) SingleSource/UnitTests/ObjC++/property-reference: 1.88% (0.7326 => 0.7464, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (0.8172 => 0.8300, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (2.2022 => 2.2358, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.42% (5.7591 => 5.8406, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (4.2646 => 4.3228, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (8.1363 => 8.2400, std. dev.: 0.0103) MultiSource/Applications/d/make_dparser: 1.20% (3.3354 => 3.3754, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.9449 => 5.0027, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5591, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0560, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.66% (26.0924 => 26.7859, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7965, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.64% (0.8651 => 0.7298, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (5.2763 => 4.7909, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.46% (2.9384 => 2.6898, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.69% (1.1194 => 1.0445, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.06% (54.1659 => 51.4269, std. dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.87% (6.6874 => 6.4285, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -3.11% (22.1758 => 21.4854, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0924, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6118, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4302, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 04:45:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 06:45:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624114515.573162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1453?compare_to=1450&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1453, Order: 159109, Start Time: 2012-06-24 09:31:09, End Time: 2012-06-24 11:46:48 To: 1450, Order: 159107, Start Time: 2012-06-24 06:46:47, End Time: 2012-06-24 09:04:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (24 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 893 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (17.4038 => 17.1706, std. dev.: 0.0449) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.15% (0.3446 => 0.3658, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3465 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.89% (0.3496 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.88% (0.3469 => 0.3673, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3442 => 0.3644, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 5.87% (0.3460 => 0.3663, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.85% (0.3488 => 0.3692, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 5.63% (0.3643 => 0.3848, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.53% (0.3650 => 0.3852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.48% (0.3724 => 0.3928, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (0.5026 => 0.5173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.64% (0.5826 => 0.5980, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.61% (0.5900 => 0.6054, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 2.53% (0.5889 => 0.6038, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (1.6211 => 1.6615, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (0.4994 => 0.5106, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (3.5627 => 3.6362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.05% (0.7171 => 0.7318, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.02% (4.2109 => 4.2959, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (1.3152 => 1.3404, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (1.9694 => 1.9960, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (1.9966 => 2.0183, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.08% (1.0781 => 1.0897, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (4.4195 => 4.4661, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.12% (2.4764 => 2.3992, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: -2.80% (11.9555 => 11.6208, std. dev.: 0.0059) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 04:46:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 06:46:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624114620.458922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1454?compare_to=1451&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1454, Order: 159110, Start Time: 2012-06-24 10:50:51, End Time: 2012-06-24 11:47:51 To: 1451, Order: 159109, Start Time: 2012-06-24 08:41:47, End Time: 2012-06-24 09:38:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.11% (3.7252 => 3.6838, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.86% (2.0176 => 2.2972, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5818 => 0.6179, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.07% (0.5748 => 0.6097, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7061 => 0.7452, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.29% (0.7038 => 0.7410, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4328 => 0.4555, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.7710 => 0.8093, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.91% (1.3693 => 1.4365, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.73% (3.9660 => 4.1535, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.60% (0.4062 => 0.4249, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.57% (0.3022 => 0.3160, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.28% (0.2781 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.26% (0.3899 => 0.4065, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3149 => 0.3282, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.22% (0.3107 => 0.3238, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2782 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2655 => 0.2765, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 4.13% (0.2690 => 0.2801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.13% (1.9828 => 2.0646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.98% (0.3489 => 0.3628, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3485 => 0.3623, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.81% (1.2292 => 1.2760, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.76% (13.8202 => 14.3404, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.60% (0.3192 => 0.3307, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.56% (0.4016 => 0.4159, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.4390 => 0.4542, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.38% (0.3756 => 0.3883, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.4563 => 1.5032, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 3.17% (0.3914 => 0.4038, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3868 => 0.3990, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 3.14% (0.3601 => 0.3714, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.13% (0.3646 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.11% (0.3663 => 0.3777, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.07% (16.6129 => 17.1231, std. dev.: 0.0144) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.98% (1.1061 => 1.1391, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: 2.98% (0.3623 => 0.3731, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.95% (1.2193 => 1.2553, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9780, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.92% (1.1364 => 1.1696, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.80% (1.9270 => 1.9809, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.68% (4.9865 => 5.1201, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.7460 => 0.7640, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (3.6692 => 3.7564, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (1.3819 => 1.4145, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (13.2842 => 13.5916, std. dev.: 0.0158) MultiSource/Applications/siod/siod: 2.25% (2.1791 => 2.2282, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.16% (14.8535 => 15.1748, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3683, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7010, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (4.3801 => 4.4633, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.8698 => 0.8850, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2394, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5112, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.5298 => 14.6825, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2698, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/mandel-2: 8.51% (1.2998 => 1.4104, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1883, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7370, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6042, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.80% (1.9199 => 1.9737, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1268, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9596, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6542, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.2308 => 1.2448, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.92% (0.4657 => 0.4102, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9846, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5953, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9008, std. dev.: 0.0364) MultiSource/Applications/minisat/minisat: -2.14% (9.3358 => 9.1363, std. dev.: 0.0195) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7770, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9847, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2543, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 04:50:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 06:50:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624115011.67C182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1455?compare_to=1452&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1455, Order: 159110, Start Time: 2012-06-24 10:50:59, End Time: 2012-06-24 11:51:42 To: 1452, Order: 159109, Start Time: 2012-06-24 08:57:29, End Time: 2012-06-24 09:58:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (32 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (11.3213 => 11.0850, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.92% (10.3673 => 11.0850, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 5.70% (0.3473 => 0.3671, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.55% (0.3497 => 0.3691, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.50% (0.3543 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.43% (0.3516 => 0.3707, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.39% (0.3561 => 0.3753, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.36% (0.3543 => 0.3733, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 5.28% (0.3694 => 0.3889, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2065 => 0.2171, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 5.02% (0.3828 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.97% (0.3927 => 0.4122, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 4.92% (0.3886 => 0.4077, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.93% (21.9371 => 22.7985, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 3.29% (10.4361 => 10.7795, std. dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.99% (7.9617 => 8.1998, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (7.0540 => 7.2498, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 2.63% (0.5925 => 0.6081, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7433 => 0.7624, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 2.49% (0.6030 => 0.6180, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (9.4845 => 9.6756, std. dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: 1.97% (0.7326 => 0.7470, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.8172 => 0.8316, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (2.2022 => 2.2369, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (4.9449 => 5.0122, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (4.2646 => 4.3209, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (8.1363 => 8.2412, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5415 => 1.5612, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8286, std. dev.: 0.0111) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3723, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (5.0018 => 5.0560, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7739, std. dev.: 0.0375) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.02% (0.8651 => 0.7352, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.98% (5.2763 => 4.8027, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.07% (2.9384 => 2.7013, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (1.1194 => 1.0507, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4519, std. dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.69% (6.6874 => 6.4409, std. dev.: 0.0264) MultiSource/Applications/ClamAV/clamscan: -2.89% (22.1758 => 21.5358, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0931, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6125, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4294, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 07:27:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 09:27:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624142731.A9B192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1456?compare_to=1453&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1456, Order: 159110, Start Time: 2012-06-24 12:13:34, End Time: 2012-06-24 14:29:04 To: 1453, Order: 159109, Start Time: 2012-06-24 09:31:09, End Time: 2012-06-24 11:46:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.18% (0.3465 => 0.3679, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.15% (0.3446 => 0.3658, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.11% (0.3469 => 0.3681, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.01% (0.3496 => 0.3706, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.98% (0.3460 => 0.3667, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 5.96% (0.3442 => 0.3647, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.93% (0.3488 => 0.3695, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 5.62% (0.3650 => 0.3855, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3724 => 0.3929, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (0.5026 => 0.5179, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.81% (0.5826 => 0.5990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.68% (0.5889 => 0.6047, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (1.6211 => 1.6607, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.31% (0.7171 => 0.7337, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (0.4994 => 0.5107, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.5900 => 0.6032, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.05% (3.5627 => 3.6358, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.98% (4.2109 => 4.2944, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.95% (1.3152 => 1.3408, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.44% (1.0781 => 1.0936, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (2.0673 => 2.0947, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.23% (0.9909 => 1.0031, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.19% (1.5932 => 1.6121, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.12% (4.4195 => 4.4691, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (1.9694 => 1.9912, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.07% (1.8794 => 1.8996, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (2.1653 => 2.1881, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.02% (2.4764 => 2.4017, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -2.67% (11.9555 => 11.6364, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.4253 => 0.4152, std. dev.: 0.0011) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 07:56:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 09:56:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624145606.AC5A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1457?compare_to=1454&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1457, Order: 159111, Start Time: 2012-06-24 14:00:48, End Time: 2012-06-24 14:57:38 To: 1454, Order: 159110, Start Time: 2012-06-24 10:50:51, End Time: 2012-06-24 11:47:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2911, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.5818 => 0.6171, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5748 => 0.6082, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 5.71% (0.7038 => 0.7440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.31% (0.7061 => 0.7436, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.87% (1.3693 => 1.4360, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.72% (3.9660 => 4.1530, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.7710 => 0.8068, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4062 => 0.4245, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.41% (0.5265 => 0.5497, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.6959 => 0.7261, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3580 => 0.3730, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.14% (0.2781 => 0.2896, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.95% (0.2782 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.95% (0.2607 => 0.2710, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2765 => 0.2874, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.93% (13.8202 => 14.3629, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (1.9828 => 2.0604, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3489 => 0.3625, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3485 => 0.3619, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2726 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2760 => 0.2864, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2761 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.2937 => 0.3046, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.67% (0.3107 => 0.3221, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.4016 => 0.4163, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.65% (0.9199 => 0.9535, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.51% (1.2292 => 1.2724, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.39% (16.6129 => 17.1759, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3534 => 0.3653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5037, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/parameter-passing: 3.22% (0.4003 => 0.4132, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8646 => 3.9882, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3293 => 0.3397, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2574, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 3.11% (0.3789 => 0.3907, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.3245 => 1.3657, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.5637 => 0.5812, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 3.10% (0.3578 => 0.3689, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.05% (0.4390 => 0.4524, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 3.04% (0.3914 => 0.4033, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.01% (0.5577 => 0.5745, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (1.1364 => 1.1706, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 2.99% (0.3940 => 0.4058, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 2.98% (0.3663 => 0.3772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.97% (0.3868 => 0.3983, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1344, std. dev.: 0.0217) SingleSource/UnitTests/ObjC/exceptions-4: 2.96% (0.3646 => 0.3754, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.95% (1.1061 => 1.1387, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.92% (1.9270 => 1.9833, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 2.86% (0.3601 => 0.3704, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.85% (0.3650 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 2.79% (0.3623 => 0.3724, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2389, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6192, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.44% (1.3813 => 1.4150, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (3.6692 => 3.7574, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2084, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4146, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6135 => 0.6278, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (7.2180 => 7.3827, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.5754 => 6.7217, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4662, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.84% (0.8698 => 0.8858, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.83% (3.1889 => 3.2471, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.4433 => 4.5172, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2749 => 1.2915, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.1007 => 2.1247, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (1.5188 => 1.5361, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3110, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: 1.06% (14.5298 => 14.6831, std. dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2699, std. dev.: 0.0449) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (1.5824 => 1.7005, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.13% (1.2998 => 1.3925, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7292, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1281, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6544, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0122) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.2308 => 1.2446, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.5627 => 21.0388, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.17% (0.9108 => 0.9001, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -2.54% (9.3358 => 9.0986, std. dev.: 0.0407) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4867 => 0.4763, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9655, std. dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7758, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9848, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2336, std. dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 08:00:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 10:00:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624150012.50DD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1458?compare_to=1455&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1458, Order: 159111, Start Time: 2012-06-24 14:00:53, End Time: 2012-06-24 15:01:45 To: 1455, Order: 159110, Start Time: 2012-06-24 10:50:59, End Time: 2012-06-24 11:51:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (35 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.79% (11.0850 => 10.8871, std. dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3516 => 0.3719, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3497 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3543 => 0.3746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3543 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.64% (0.3561 => 0.3762, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3694 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.43% (0.3886 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.33% (0.3828 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.30% (0.3927 => 0.4135, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.01% (10.3673 => 10.8871, std. dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 3.82% (21.9371 => 22.7747, std. dev.: 0.0219) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (10.4361 => 10.7972, std. dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.00% (7.9617 => 8.2008, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 2.89% (0.6030 => 0.6204, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 2.85% (0.5925 => 0.6094, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (7.0540 => 7.2481, std. dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (9.4845 => 9.6865, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 1.88% (0.7326 => 0.7464, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (0.8172 => 0.8309, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 1.62% (0.7835 => 0.7962, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (2.2022 => 2.2350, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (4.2646 => 4.3252, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.35% (3.3354 => 3.3804, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (8.1363 => 8.2451, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.9449 => 5.0100, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.23% (1.5415 => 1.5605, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8262, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (5.0018 => 5.0592, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 1.08% (1.2842 => 1.2981, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.07% (1.1642 => 1.1766, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7533, std. dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.00% (0.9957 => 1.0057, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.51% (0.8651 => 0.7309, std. dev.: 0.0301) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.24% (5.2763 => 4.7890, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (2.9384 => 2.6984, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.42% (1.1194 => 1.0475, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3523, std. dev.: 0.0474) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.85% (6.6874 => 6.4299, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -2.97% (22.1758 => 21.5163, std. dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0918, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6109, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4299, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 09:19:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 11:19:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624161941.E113E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1459?compare_to=1457&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1459, Order: 159112, Start Time: 2012-06-24 15:24:32, End Time: 2012-06-24 16:21:13 To: 1457, Order: 159111, Start Time: 2012-06-24 14:00:48, End Time: 2012-06-24 14:57:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (742 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.52% (2.0176 => 2.2904, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.5818 => 0.6168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.76% (0.5748 => 0.6079, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.58% (0.7038 => 0.7431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7061 => 0.7428, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4328 => 0.4552, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.84% (0.7710 => 0.8083, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 4.81% (1.3693 => 1.4351, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1522, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4062 => 0.4242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.37% (0.5265 => 0.5495, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.2966 => 0.3091, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.6959 => 0.7246, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3899 => 0.4059, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.92% (1.9828 => 2.0605, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.91% (0.2765 => 0.2873, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3552, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2726 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.84% (0.2607 => 0.2707, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.83% (0.2690 => 0.2793, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2761 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2655 => 0.2755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2760 => 0.2863, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3453 => 0.3580, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.2937 => 0.3045, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4016 => 0.4162, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 3.60% (0.3107 => 0.3219, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3149 => 0.3262, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3485 => 0.3609, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9199 => 0.9525, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3534 => 0.3651, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.27% (16.6129 => 17.1558, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3192 => 0.3296, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (0.3293 => 0.3400, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.23% (0.4390 => 0.4532, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 3.22% (0.4003 => 0.4132, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5027, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 3.18% (3.8646 => 3.9874, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 3.10% (0.3578 => 0.3689, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.09% (0.3914 => 0.4035, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3868 => 0.3986, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.04% (1.2193 => 1.2564, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.3245 => 1.3646, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 2.98% (0.3789 => 0.3902, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.94% (4.9865 => 5.1331, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.1364 => 1.1698, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.91% (0.3646 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 2.89% (0.3663 => 0.3769, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 2.89% (0.3601 => 0.3705, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.86% (1.1061 => 1.1377, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.82% (0.3650 => 0.3753, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.80% (0.7506 => 0.7716, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.74% (1.9270 => 1.9798, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (3.6692 => 3.7613, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.44% (2.1791 => 2.2323, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.3813 => 1.4139, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.1993, std. dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5922, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (0.4379 => 0.4480, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.27% (1.3819 => 1.4133, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.10% (7.2180 => 7.3695, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.5754 => 6.7098, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (0.8698 => 0.8855, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.3801 => 4.4575, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2436, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.4433 => 4.5127, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3107, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1229, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1881, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.88% (1.2998 => 1.4022, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7188, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9191, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.04% (11.2619 => 11.6038, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.93% (7.9275 => 8.1601, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.5928 => 4.6523, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9523, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.32% (0.4657 => 0.4130, std. dev.: 0.0170) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0470, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.17% (0.9108 => 0.9001, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5972, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1002, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.30% (20.3410 => 19.8724, std. dev.: 0.0519) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7760, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9850, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2611, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2540, std. dev.: 0.0257) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 09:28:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 11:28:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624162805.7495C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1460?compare_to=1458&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1460, Order: 159112, Start Time: 2012-06-24 15:28:49, End Time: 2012-06-24 16:29:38 To: 1458, Order: 159111, Start Time: 2012-06-24 14:00:53, End Time: 2012-06-24 15:01:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (35 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3473 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3543 => 0.3749, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.80% (0.3497 => 0.3700, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3543 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3561 => 0.3765, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-3: 5.72% (0.3516 => 0.3717, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.55% (0.3694 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3828 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.32% (0.3927 => 0.4136, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.28% (0.3886 => 0.4091, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.00% (10.3673 => 10.8858, std. dev.: 0.0165) MultiSource/Applications/JM/lencod/lencod: 3.78% (21.9371 => 22.7673, std. dev.: 0.0257) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (10.4361 => 10.8127, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.96% (7.9617 => 8.1973, std. dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference-object: 2.90% (0.6030 => 0.6205, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 2.82% (0.5925 => 0.6092, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.73% (7.0540 => 7.2466, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.8172 => 0.8340, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (9.4845 => 9.6705, std. dev.: 0.0239) SingleSource/UnitTests/ObjC++/property-reference: 1.91% (0.7326 => 0.7466, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.80% (0.7835 => 0.7976, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (2.2022 => 2.2347, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.45% (8.1363 => 8.2544, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.43% (4.2646 => 4.3257, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.9449 => 5.0154, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.5415 => 1.5606, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.19% (3.3354 => 3.3752, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (5.0018 => 5.0608, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8255, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2842 => 1.2985, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.08% (2.0273 => 2.0492, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1861 => 1.1981, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.43% (26.0924 => 26.7263, std. dev.: 0.0285) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7952, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.77% (0.8651 => 0.7287, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.27% (5.2763 => 4.7874, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.26% (2.9384 => 2.6958, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.38% (1.1194 => 1.0480, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3712, std. dev.: 0.0354) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.87% (6.6874 => 6.4285, std. dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: -2.93% (22.1758 => 21.5255, std. dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0917, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.81% (32.5116 => 31.5988, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 10:10:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 12:10:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624171002.0A42C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1461?compare_to=1456&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1461, Order: 159112, Start Time: 2012-06-24 14:55:54, End Time: 2012-06-24 17:11:34 To: 1456, Order: 159110, Start Time: 2012-06-24 12:13:34, End Time: 2012-06-24 14:29:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (31 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (861 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.70% (0.3792 => 0.4463, std. dev.: 0.0257) SingleSource/UnitTests/ObjC/exceptions-2: 6.07% (0.3446 => 0.3655, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3465 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.02% (0.3488 => 0.3698, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.01% (0.3460 => 0.3668, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 5.95% (0.3496 => 0.3704, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.94% (0.3469 => 0.3675, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3442 => 0.3645, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.67% (0.3650 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.63% (0.3643 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3724 => 0.3929, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (0.5026 => 0.5179, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 2.76% (0.5826 => 0.5987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.62% (0.5889 => 0.6043, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.5900 => 0.6053, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (1.6211 => 1.6631, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (0.4994 => 0.5119, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.27% (0.7171 => 0.7334, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (3.5627 => 3.6416, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.13% (1.3152 => 1.3432, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.09% (4.2109 => 4.2988, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (0.5000 => 0.5104, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (4.4195 => 4.4890, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.46% (1.9694 => 1.9982, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.40% (0.9909 => 1.0048, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.34% (1.0781 => 1.0926, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (2.0673 => 2.0946, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.18% (1.8794 => 1.9016, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (1.9966 => 2.0199, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.08% (23.5202 => 23.7740, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (2.1653 => 2.1878, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.18% (2.4764 => 2.3977, std. dev.: 0.0230) MultiSource/Applications/kimwitu++/kc: -2.70% (11.9555 => 11.6331, std. dev.: 0.0100) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 10:43:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 12:43:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120624174317.0AE3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1462?compare_to=1459&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1462, Order: 159116, Start Time: 2012-06-24 16:48:04, End Time: 2012-06-24 17:44:49 To: 1459, Order: 159112, Start Time: 2012-06-24 15:24:32, End Time: 2012-06-24 16:21:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.00% (7.9724 => 8.0523, std. dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.95% (2.0176 => 2.2990, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.5818 => 0.6175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.85% (0.5748 => 0.6084, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.78% (0.7038 => 0.7445, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7061 => 0.7438, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.10% (1.3693 => 1.4391, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7710 => 0.8092, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.91% (3.9660 => 4.1609, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3022 => 0.3166, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.3899 => 0.4071, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.37% (0.6959 => 0.7263, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.22% (13.8202 => 14.4033, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.22% (0.2655 => 0.2767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.9828 => 2.0664, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.2966 => 0.3090, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3580 => 0.3728, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.13% (0.2761 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3453 => 0.3595, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2628 => 0.2736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.11% (0.4016 => 0.4181, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.06% (0.3107 => 0.3233, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.00% (0.3149 => 0.3275, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.93% (0.2696 => 0.2802, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.2292 => 1.2770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3756 => 0.3894, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9199 => 0.9536, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.63% (0.3192 => 0.3308, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.61% (0.2988 => 0.3096, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 3.55% (16.6129 => 17.2034, std. dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 3.49% (1.0594 => 1.0964, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (3.8646 => 3.9980, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (1.4563 => 1.5055, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (4.9865 => 5.1488, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (1.1364 => 1.1722, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.3245 => 1.3661, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 3.13% (0.3578 => 0.3690, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.10% (0.5577 => 0.5750, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.09% (0.3914 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.04% (0.3646 => 0.3757, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.00% (1.9270 => 1.9849, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 3.00% (0.3601 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 2.98% (0.3663 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 2.94% (0.3940 => 0.4056, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 2.90% (0.3623 => 0.3728, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.84% (0.7506 => 0.7719, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.7460 => 0.7656, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.62% (2.1791 => 2.2363, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (3.6692 => 3.7650, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2345, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4379 => 0.4489, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6135, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.46% (0.4791 => 0.4909, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.3819 => 1.4154, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6135 => 0.6281, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.3813 => 1.4139, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.5754 => 6.7229, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.22% (7.2180 => 7.3782, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.8698 => 0.8887, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.92% (3.1889 => 3.2500, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (4.3801 => 4.4636, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5197, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1333 => 1.1509, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.35% (3.2742 => 3.3183, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 1.30% (14.5298 => 14.7186, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1266, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (1.5188 => 1.5358, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (8.4961 => 8.5890, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0574) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9996 => 1.0791, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7387, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.05% (11.2619 => 11.6053, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1273, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6531, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.70% (0.4657 => 0.3926, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0913, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5964, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.38% (9.3358 => 9.1140, std. dev.: 0.0310) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (0.8342 => 0.8155, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9168, std. dev.: 0.0362) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.57% (28.2225 => 27.7795, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2598, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9859, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.06% (7.3305 => 7.2530, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 10:56:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 12:56:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120624175600.332642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1463?compare_to=1460&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1463, Order: 159116, Start Time: 2012-06-24 16:56:39, End Time: 2012-06-24 17:57:31 To: 1460, Order: 159112, Start Time: 2012-06-24 15:28:49, End Time: 2012-06-24 16:29:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 5.93% (0.3543 => 0.3753, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3473 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3497 => 0.3701, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3543 => 0.3747, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 5.75% (0.3516 => 0.3718, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3561 => 0.3765, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 5.55% (0.3694 => 0.3899, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.35% (0.3886 => 0.4094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.3927 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.30% (0.3828 => 0.4031, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 5.01% (10.3673 => 10.8870, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.82% (21.9371 => 22.7750, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 3.47% (10.4361 => 10.7981, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.08% (7.9617 => 8.2069, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference-object: 2.87% (0.6030 => 0.6203, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (7.0540 => 7.2544, std. dev.: 0.0155) SingleSource/UnitTests/ObjC++/Hello: 2.84% (0.5925 => 0.6093, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.8172 => 0.8359, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7326 => 0.7478, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (9.4845 => 9.6723, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.9449 => 5.0200, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (2.2022 => 2.2348, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.46% (0.7835 => 0.7949, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.1363 => 8.2520, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5630, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.31% (4.2646 => 4.3205, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 1.23% (3.3354 => 3.3764, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (5.0018 => 5.0608, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.16% (5.7591 => 5.8258, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 1.04% (1.2842 => 1.2976, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.01% (2.0273 => 2.0477, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7587, std. dev.: 0.0301) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7953, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.78% (0.8651 => 0.7286, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.23% (5.2763 => 4.7891, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.18% (2.9384 => 2.6980, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.39% (1.1194 => 1.0479, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3700, std. dev.: 0.1216) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.86% (6.6874 => 6.4290, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -2.91% (22.1758 => 21.5307, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0919, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6110, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4305, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 12:52:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 14:52:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120624195240.DFB982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1464?compare_to=1461&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1464, Order: 159116, Start Time: 2012-06-24 17:38:25, End Time: 2012-06-24 19:54:13 To: 1461, Order: 159112, Start Time: 2012-06-24 14:55:54, End Time: 2012-06-24 17:11:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (28 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.65% (0.2125 => 0.2245, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.39% (0.3792 => 0.4262, std. dev.: 0.0149) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.59% (0.3488 => 0.3718, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.04% (0.3446 => 0.3654, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.01% (0.3460 => 0.3668, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.00% (0.3465 => 0.3673, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3442 => 0.3648, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.88% (0.3469 => 0.3673, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3496 => 0.3701, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.71% (0.3643 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.64% (0.3724 => 0.3934, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 5.59% (0.3650 => 0.3854, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (0.5026 => 0.5182, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.73% (0.5826 => 0.5985, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (1.6211 => 1.6617, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7171 => 0.7350, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.48% (0.5889 => 0.6035, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.5900 => 0.6042, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (3.5627 => 3.6429, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 2.01% (4.2109 => 4.2956, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.00% (1.3152 => 1.3415, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (4.4195 => 4.4831, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (2.0673 => 2.0952, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.33% (1.0781 => 1.0924, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.31% (0.9909 => 1.0039, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (1.9694 => 1.9935, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (1.9966 => 2.0209, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.13% (1.8794 => 1.9007, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.83% (2.4764 => 2.4062, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: -2.68% (11.9555 => 11.6354, std. dev.: 0.0093) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 18:24:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 20:24:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625012458.625DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1465?compare_to=1462&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1465, Order: 159119, Start Time: 2012-06-25 00:29:32, End Time: 2012-06-25 01:26:31 To: 1462, Order: 159116, Start Time: 2012-06-24 16:48:04, End Time: 2012-06-24 17:44:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.49% (2.0176 => 2.2897, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.42% (0.1072 => 0.1173, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.86% (0.5818 => 0.6159, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.62% (0.5748 => 0.6071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.7710 => 0.8135, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.43% (0.7038 => 0.7420, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7061 => 0.7428, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1499, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4062 => 0.4250, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.57% (0.3022 => 0.3160, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.15% (0.3899 => 0.4061, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2765 => 0.2879, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2781 => 0.2895, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.01% (0.2966 => 0.3085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.99% (0.2782 => 0.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.6959 => 0.7233, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (1.9828 => 2.0598, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.84% (13.8202 => 14.3512, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 3.84% (0.2607 => 0.2707, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3489 => 0.3622, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2760 => 0.2865, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2655 => 0.2755, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2690 => 0.2791, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2726 => 0.2828, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.69% (0.2761 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (0.3485 => 0.3613, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.64% (0.3107 => 0.3220, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.61% (0.2937 => 0.3043, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.2292 => 1.2729, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3756 => 0.3880, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.30% (16.6129 => 17.1608, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (0.3293 => 0.3400, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3192 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.4563 => 1.5019, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.10% (0.4390 => 0.4526, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9834, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: 3.05% (0.4003 => 0.4125, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2563, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5637 => 0.5807, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.00% (0.3868 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 2.94% (0.3601 => 0.3707, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 2.93% (0.3578 => 0.3683, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1327, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 2.91% (0.3914 => 0.4028, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.90% (0.3789 => 0.3899, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.90% (1.1061 => 1.1382, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 2.83% (0.3646 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.81% (0.3663 => 0.3766, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.76% (1.9270 => 1.9802, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 2.74% (0.3940 => 0.4048, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.74% (0.3650 => 0.3750, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2297, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7594, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.7460 => 0.7640, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6135 => 0.6283, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (1.3819 => 1.4148, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5990, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4138, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (7.2180 => 7.3651, std. dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.5754 => 6.7072, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8698 => 0.8861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.3801 => 4.4584, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.64% (3.1889 => 3.2411, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (4.4433 => 4.5133, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1007 => 2.1234, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3094, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.31% (1.8175 => 2.2776, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.62% (2.0200 => 2.1942, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9996 => 1.0813, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7250, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.06% (11.2619 => 11.6064, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.80% (7.9275 => 8.1492, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.34% (4.5928 => 4.6545, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.24% (1.2308 => 1.2461, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0381, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3511 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.22% (0.9108 => 0.8997, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5940, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1039, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8946, std. dev.: 0.0699) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5120, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.59% (28.2225 => 27.7743, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2608, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4882, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.3305 => 7.2556, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 18:29:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 20:29:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625012937.DC97F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1466?compare_to=1463&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1466, Order: 159119, Start Time: 2012-06-25 00:30:17, End Time: 2012-06-25 01:31:11 To: 1463, Order: 159116, Start Time: 2012-06-24 16:56:39, End Time: 2012-06-24 17:57:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.31% (0.3473 => 0.3692, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.18% (0.3497 => 0.3713, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3543 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.11% (0.3516 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.07% (0.3543 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3561 => 0.3775, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.90% (0.3694 => 0.3912, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 5.76% (0.3927 => 0.4153, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3828 => 0.4045, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.58% (0.3886 => 0.4103, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.96% (10.3673 => 10.8818, std. dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 3.84% (21.9371 => 22.7787, std. dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (10.4361 => 10.8049, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 3.10% (0.6030 => 0.6217, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.02% (0.5925 => 0.6104, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.90% (7.9617 => 8.1922, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (7.0540 => 7.2564, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (0.7433 => 0.7632, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.25% (0.7326 => 0.7491, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (9.4845 => 9.6747, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.8172 => 0.8328, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 1.60% (0.7835 => 0.7960, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (2.2022 => 2.2365, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.46% (8.1363 => 8.2553, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.41% (4.2646 => 4.3248, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0119, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (5.0018 => 5.0687, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.26% (3.3354 => 3.3774, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8287, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.5415 => 1.5592, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2842 => 1.2984, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.04% (2.0273 => 2.0483, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7911, std. dev.: 0.0236) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7949, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.65% (0.8651 => 0.7297, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7939, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (2.9384 => 2.6977, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.26% (1.1194 => 1.0493, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3510, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.52% (6.6874 => 6.4518, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -2.90% (22.1758 => 21.5323, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0922, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6103, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4300, std. dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 19:43:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 21:43:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625024332.42B3D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1467?compare_to=1464&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1467, Order: 159119, Start Time: 2012-06-25 00:29:36, End Time: 2012-06-25 02:45:05 To: 1464, Order: 159116, Start Time: 2012-06-24 17:38:25, End Time: 2012-06-24 19:54:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (32 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (861 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.66% (0.2261 => 0.2389, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.65% (0.3446 => 0.3675, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.54% (0.3488 => 0.3716, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.53% (0.3460 => 0.3686, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3442 => 0.3666, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.46% (0.3465 => 0.3689, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.43% (0.3469 => 0.3692, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.35% (0.3496 => 0.3718, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.18% (0.3643 => 0.3868, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.03% (0.3650 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3724 => 0.3946, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (0.5026 => 0.5190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.04% (0.5826 => 0.6003, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 2.84% (0.5889 => 0.6056, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.78% (1.6211 => 1.6661, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.5900 => 0.6052, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.54% (0.4994 => 0.5121, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.47% (3.5627 => 3.6508, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 2.40% (0.7171 => 0.7343, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (1.3152 => 1.3465, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.28% (4.2109 => 4.3071, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (0.5000 => 0.5105, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (4.4195 => 4.4879, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.53% (1.0781 => 1.0946, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.47% (0.9909 => 1.0055, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (1.9694 => 1.9970, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (2.0673 => 2.0942, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (1.9966 => 2.0215, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.17% (1.8794 => 1.9014, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (2.1653 => 2.1901, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.07% (23.5202 => 23.7726, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.06% (4.6177 => 4.6667, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.61% (11.9555 => 11.6432, std. dev.: 0.0152) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 21:56:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 24 Jun 2012 23:56:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625045609.460052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1468?compare_to=1465&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1468, Order: 159120, Start Time: 2012-06-25 04:00:56, End Time: 2012-06-25 04:57:41 To: 1465, Order: 159119, Start Time: 2012-06-25 00:29:32, End Time: 2012-06-25 01:26:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.62% (2.0176 => 2.2924, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.5818 => 0.6183, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/Hello: 6.00% (0.5748 => 0.6093, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.84% (0.7038 => 0.7449, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7061 => 0.7455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 5.07% (1.3693 => 1.4387, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7710 => 0.8097, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (3.9660 => 4.1583, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3022 => 0.3166, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.75% (0.2781 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3899 => 0.4082, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (1.9828 => 2.0721, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.42% (0.2760 => 0.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.6959 => 0.7261, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3489 => 0.3640, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2696 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3192 => 0.3322, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2788, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.97% (13.8202 => 14.3689, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.9199 => 0.9541, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3534 => 0.3662, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3868 => 0.4007, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4390 => 0.4544, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 3.49% (16.6129 => 17.1930, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0960, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5037, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9903, std. dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: 3.24% (0.3578 => 0.3694, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.19% (1.2193 => 1.2582, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 3.15% (0.3646 => 0.3761, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.3245 => 1.3662, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 3.14% (0.3914 => 0.4037, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5577 => 0.5749, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.9865 => 5.1383, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.1364 => 1.1703, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 2.97% (0.3601 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.95% (1.9270 => 1.9838, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.92% (0.7506 => 0.7725, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.89% (1.1061 => 1.1381, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.65% (2.1791 => 2.2368, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3813 => 1.4175, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.48% (1.3819 => 1.4162, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (3.6692 => 3.7599, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (13.2842 => 13.6094, std. dev.: 0.0122) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2130, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.37% (0.4379 => 0.4483, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (7.2180 => 7.3815, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.8698 => 0.8895, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7194, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4626, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (4.4433 => 4.5207, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2426, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.1333 => 1.1503, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (2.1007 => 2.1270, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.2742 => 3.3128, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.13% (14.5298 => 14.6941, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2761, std. dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3906, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7330, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.03% (11.2619 => 11.6032, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1488, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6547, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std. dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.68% (22.5627 => 21.0561, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5810, std. dev.: 0.0116) MultiSource/Applications/minisat/minisat: -2.56% (9.3358 => 9.0964, std. dev.: 0.0336) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.36% (20.3410 => 19.8617, std. dev.: 0.0529) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.8342 => 0.8154, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5117, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (28.2225 => 27.7757, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.32% (3.0263 => 2.9863, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2477, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2514, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 22:00:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 00:00:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625050016.003322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1469?compare_to=1466&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1469, Order: 159120, Start Time: 2012-06-25 04:01:06, End Time: 2012-06-25 05:01:48 To: 1466, Order: 159119, Start Time: 2012-06-25 00:30:17, End Time: 2012-06-25 01:31:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (831 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (10.8818 => 11.1518, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (20.0850 => 19.8679, std. dev.: 0.0763) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.57% (10.3673 => 11.1518, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 6.36% (0.3473 => 0.3694, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.32% (0.3543 => 0.3767, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.04% (0.3543 => 0.3757, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3561 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.97% (0.3516 => 0.3726, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.87% (0.3694 => 0.3911, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.70% (0.3927 => 0.4151, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.64% (0.3828 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.56% (0.3886 => 0.4102, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.71% (21.9371 => 22.7501, std. dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (10.4361 => 10.7564, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 2.99% (0.5925 => 0.6102, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (7.0540 => 7.2608, std. dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.93% (7.9617 => 8.1949, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference-object: 2.87% (0.6030 => 0.6203, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (0.7433 => 0.7628, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7326 => 0.7481, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (0.8172 => 0.8338, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (9.4845 => 9.6679, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 1.52% (0.7835 => 0.7954, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.47% (4.9449 => 5.0176, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.39% (4.2646 => 4.3238, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (8.1363 => 8.2457, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.23% (5.7591 => 5.8299, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.20% (2.0273 => 2.0516, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (5.0018 => 5.0575, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3724, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7460, std. dev.: 0.0225) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7948, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.07% (0.8651 => 0.7261, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7840, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (2.9384 => 2.7008, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0477, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3921, std. dev.: 0.0421) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.04% (6.6874 => 6.4172, std. dev.: 0.0172) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4876, std. dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0923, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6080, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: -2.21% (1.1277 => 1.1028, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 23:14:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 01:14:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625061453.189492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1470?compare_to=1467&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1470, Order: 159120, Start Time: 2012-06-25 04:00:58, End Time: 2012-06-25 06:16:26 To: 1467, Order: 159119, Start Time: 2012-06-25 00:29:36, End Time: 2012-06-25 02:45:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (27 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.75% (2.0493 => 2.0852, std. dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 6.73% (0.3460 => 0.3693, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.73% (0.3446 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.71% (0.3488 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3465 => 0.3695, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3469 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3442 => 0.3670, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3496 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3643 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.25% (0.3650 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.3724 => 0.3955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.52% (0.5826 => 0.6031, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.43% (0.5889 => 0.6091, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (0.5026 => 0.5185, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 2.73% (0.7171 => 0.7367, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (1.6211 => 1.6643, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (0.4994 => 0.5110, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (3.5627 => 3.6438, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (1.3152 => 1.3426, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.97% (4.2109 => 4.2938, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 1.39% (1.5932 => 1.6154, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0673 => 2.0950, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.32% (0.9909 => 1.0040, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.28% (1.0781 => 1.0919, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.24% (1.9694 => 1.9938, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (1.9966 => 2.0204, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (4.4195 => 4.4694, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.72% (11.9555 => 11.6298, std. dev.: 0.0192) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 23:19:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 01:19:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625061945.67B122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1471?compare_to=1468&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1471, Order: 159121, Start Time: 2012-06-25 05:24:34, End Time: 2012-06-25 06:21:18 To: 1468, Order: 159120, Start Time: 2012-06-25 04:00:56, End Time: 2012-06-25 04:57:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.57% (1.3906 => 1.4124, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.98% (2.0176 => 2.2997, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.5818 => 0.6181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.93% (0.5748 => 0.6089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7038 => 0.7452, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7061 => 0.7459, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.23% (1.3693 => 1.4409, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.16% (0.3022 => 0.3178, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (3.9660 => 4.1663, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.90% (0.3899 => 0.4090, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.75% (0.2781 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5265 => 0.5506, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (1.9828 => 2.0727, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.47% (0.6959 => 0.7270, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.20% (13.8202 => 14.4011, std. dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9199 => 0.9552, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4390 => 0.4557, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.4563 => 1.5101, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.61% (16.6129 => 17.2121, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 3.56% (1.0594 => 1.0971, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.2925 => 0.3027, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (3.8646 => 3.9962, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.35% (1.1364 => 1.1745, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 3.35% (0.4003 => 0.4137, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5637 => 0.5822, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.27% (1.2193 => 1.2592, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5577 => 0.5759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.24% (0.3578 => 0.3694, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.23% (1.1061 => 1.1418, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.20% (1.9270 => 1.9887, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 3.19% (0.3914 => 0.4039, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1456, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 3.11% (0.3601 => 0.3713, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.10% (0.3646 => 0.3759, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.02% (0.7506 => 0.7733, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 2.95% (0.3623 => 0.3730, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2400, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.63% (3.6692 => 3.7657, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.62% (1.3819 => 1.4181, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.7460 => 0.7655, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (1.3813 => 1.4174, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2416, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4379 => 0.4493, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.2842 => 13.6223, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.8698 => 0.8908, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4791 => 0.4904, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.35% (7.2180 => 7.3873, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 2.21% (6.5754 => 6.7209, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4655, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.94% (3.1889 => 3.2507, std. dev.: 0.0168) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.4433 => 4.5244, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.60% (1.1333 => 1.1514, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.2742 => 3.3214, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1299, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5188 => 1.5381, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7020, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (8.4961 => 8.5866, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2727, std. dev.: 0.0487) SingleSource/Benchmarks/Misc/mandel-2: 8.66% (1.2998 => 1.4124, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7313, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.90% (11.2619 => 11.5880, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.89% (7.9275 => 8.1563, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.02% (10.7476 => 10.8570, std. dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std. dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1017, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3511 => 0.3364, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.87% (2.5089 => 2.4117, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0977, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6089, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9432, std. dev.: 0.0367) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2536, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9849, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8581, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jun 24 23:27:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 01:27:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625062759.05FFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1472?compare_to=1469&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1472, Order: 159121, Start Time: 2012-06-25 05:28:52, End Time: 2012-06-25 06:29:32 To: 1469, Order: 159120, Start Time: 2012-06-25 04:01:06, End Time: 2012-06-25 05:01:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 2 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (11.1518 => 10.7675, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.18% (28.0778 => 27.7474, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3543 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3497 => 0.3704, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3543 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3561 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3516 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.63% (0.3694 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.55% (0.3927 => 0.4145, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.46% (0.3828 => 0.4037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.43% (0.3886 => 0.4097, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.86% (10.3673 => 10.7675, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 3.60% (21.9371 => 22.7258, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (10.4361 => 10.7585, std. dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.7433 => 0.7652, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.86% (7.9617 => 8.1893, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 2.84% (0.6030 => 0.6201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.75% (0.5925 => 0.6088, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (7.0540 => 7.2213, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 2.10% (0.7326 => 0.7480, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.8172 => 0.8329, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (9.4845 => 9.6624, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (2.2022 => 2.2349, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (8.1363 => 8.2484, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (4.2646 => 4.3230, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 1.29% (5.7591 => 5.8333, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.9449 => 5.0077, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.22% (1.5415 => 1.5603, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.19% (2.0273 => 2.0514, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 1.18% (3.3354 => 3.3746, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.0018 => 5.0568, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.2842 => 1.2973, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7236, std. dev.: 0.0266) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7972, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.74% (0.8651 => 0.7289, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7880, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (2.9384 => 2.6964, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.42% (1.1194 => 1.0475, std. dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3899, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.87% (6.6874 => 6.4286, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -2.98% (22.1758 => 21.5150, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0927, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.76% (32.5116 => 31.6137, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4309, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 00:46:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 02:46:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625074604.E761E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1473?compare_to=1471&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1473, Order: 159125, Start Time: 2012-06-25 06:48:08, End Time: 2012-06-25 07:47:35 To: 1471, Order: 159121, Start Time: 2012-06-25 05:24:34, End Time: 2012-06-25 06:21:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (765 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.00% (2.0176 => 2.3001, std. dev.: 0.0532) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.5818 => 0.6180, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5748 => 0.6091, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.89% (0.7061 => 0.7477, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (0.4328 => 0.4577, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 5.26% (1.3693 => 1.4413, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (3.9660 => 4.1613, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 4.81% (0.2726 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2782 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3107 => 0.3249, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.4390 => 0.4582, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3453 => 0.3602, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.14% (13.8202 => 14.3926, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2794, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3534 => 0.3666, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.56% (16.6129 => 17.2036, std. dev.: 0.0347) SingleSource/UnitTests/ObjC/parameter-passing: 3.30% (0.4003 => 0.4135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.26% (0.7506 => 0.7751, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9903, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.22% (0.3914 => 0.4040, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.15% (4.9865 => 5.1434, std. dev.: 0.0146) MultiSource/Applications/treecc/treecc: 3.14% (1.9270 => 1.9875, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 3.10% (0.3646 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.08% (0.3663 => 0.3776, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.07% (0.3940 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.01% (0.3650 => 0.3760, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 3.00% (0.3601 => 0.3709, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 2.95% (0.3623 => 0.3730, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3755 => 0.3863, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.7460 => 0.7668, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.78% (2.1791 => 2.2396, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6135 => 0.6297, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.59% (14.8535 => 15.2381, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.8698 => 0.8910, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7126, std. dev.: 0.0109) MultiSource/Applications/d/make_dparser: 1.99% (3.1889 => 3.2523, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6283 => 0.6392, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.63% (1.1333 => 1.1518, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1283, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5188 => 1.5381, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 1.17% (14.5298 => 14.6996, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.63% (0.1824 => 0.3550, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0134) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.35% (1.5824 => 1.6987, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7335, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5878, std. dev.: 0.0208) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1406, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0409) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8672, std. dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (22.5627 => 21.0834, std. dev.: 0.4373) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.62% (9.3358 => 9.0911, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6046, std. dev.: 0.0619) MultiSource/Benchmarks/Olden/health/health: -2.27% (0.4533 => 0.4430, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.6320 => 6.5178, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2488, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0058, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9832, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8583, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 00:57:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 02:57:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625075757.AB2902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1474?compare_to=1472&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1474, Order: 159126, Start Time: 2012-06-25 06:56:30, End Time: 2012-06-25 07:59:30 To: 1472, Order: 159121, Start Time: 2012-06-25 05:28:52, End Time: 2012-06-25 06:29:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (26 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.53% (3.8273 => 3.7686, std. dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3473 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.35% (0.3497 => 0.3719, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.32% (0.3543 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.31% (0.3516 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.29% (0.3543 => 0.3766, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.23% (0.3561 => 0.3783, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.06% (0.3694 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.82% (0.3886 => 0.4112, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3828 => 0.4050, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.76% (0.3927 => 0.4153, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.41% (10.3673 => 10.7212, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 3.07% (0.6030 => 0.6215, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.74% (7.9617 => 8.1797, std. dev.: 0.0150) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7326 => 0.7519, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (7.0540 => 7.2301, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.42% (0.8172 => 0.8370, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (9.4845 => 9.6569, std. dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.54% (4.2646 => 4.3301, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.1363 => 8.2504, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.9449 => 5.0104, std. dev.: 0.0155) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (5.0018 => 5.0629, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.08% (1.4186 => 1.4339, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.06% (1.5415 => 1.5579, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.48% (26.0924 => 26.7400, std. dev.: 0.0214) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7974, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.87% (0.8651 => 0.7278, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.50% (5.2763 => 4.7750, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.40% (2.9384 => 2.6915, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.83% (1.1194 => 1.0430, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3254, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.10% (6.6874 => 6.4129, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.12% (5.3855 => 5.3254, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.11% (5.3526 => 5.2932, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.01% (1.7609 => 1.7431, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0924, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.76% (32.5116 => 31.6145, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -2.23% (1.1277 => 1.1026, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4306, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 01:59:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 03:59:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625085927.C36B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1475?compare_to=1470&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1475, Order: 159125, Start Time: 2012-06-25 06:43:17, End Time: 2012-06-25 09:01:00 To: 1470, Order: 159120, Start Time: 2012-06-25 04:00:58, End Time: 2012-06-25 06:16:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (29 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (863 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.28% (0.4333 => 0.4995, std. dev.: 0.0230) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.72% (0.3792 => 0.4995, std. dev.: 0.0230) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3460 => 0.3709, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.17% (0.3446 => 0.3693, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.17% (0.3488 => 0.3738, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.12% (0.3442 => 0.3687, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3465 => 0.3711, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.95% (0.3469 => 0.3710, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3496 => 0.3737, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.74% (0.3650 => 0.3896, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3643 => 0.3886, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 6.42% (0.3724 => 0.3963, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5826 => 0.6023, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.06% (0.5889 => 0.6069, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (0.5026 => 0.5167, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.5900 => 0.6058, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (1.6211 => 1.6603, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (0.4994 => 0.5101, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (3.5627 => 3.6380, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (0.5000 => 0.5104, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (1.3152 => 1.3422, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 1.94% (0.7171 => 0.7310, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 1.82% (4.2109 => 4.2876, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (2.0673 => 2.0996, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (1.9694 => 1.9949, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (4.4195 => 4.4715, std. dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 1.16% (1.5932 => 1.6117, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 1.15% (23.5202 => 23.7907, std. dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (1.9966 => 2.0181, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (1.8794 => 1.8990, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.82% (2.4764 => 2.4066, std. dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: -2.56% (11.9555 => 11.6496, std. dev.: 0.0152) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 02:10:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 04:10:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625091009.F285B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1476?compare_to=1473&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1476, Order: 159127, Start Time: 2012-06-25 08:14:53, End Time: 2012-06-25 09:11:42 To: 1473, Order: 159125, Start Time: 2012-06-25 06:48:08, End Time: 2012-06-25 07:47:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.88% (2.0176 => 2.2977, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.29% (0.5818 => 0.6184, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 6.12% (0.5748 => 0.6100, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4328 => 0.4584, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.73% (0.7038 => 0.7441, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7061 => 0.7457, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 5.24% (1.3693 => 1.4411, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (3.9660 => 4.1645, std. dev.: 0.0161) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2781 => 0.2920, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.99% (0.2765 => 0.2903, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.7710 => 0.8077, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.76% (0.2690 => 0.2818, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.75% (0.2760 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2655 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.9828 => 2.0755, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.66% (0.2937 => 0.3074, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.49% (0.2696 => 0.2817, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.31% (1.2292 => 1.2822, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.28% (0.3293 => 0.3434, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.19% (13.8202 => 14.3997, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4390 => 0.4565, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.55% (16.6129 => 17.2024, std. dev.: 0.0356) MultiSource/Benchmarks/nbench/nbench: 3.54% (1.0594 => 1.0969, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 3.50% (0.4003 => 0.4143, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5066, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 3.35% (0.3578 => 0.3698, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.33% (1.1061 => 1.1429, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 3.33% (0.3789 => 0.3915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3684, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 3.30% (0.3663 => 0.3784, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 3.28% (0.7506 => 0.7752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.3914 => 0.4042, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9903, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: 3.19% (0.3601 => 0.3716, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.15% (0.3650 => 0.3765, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.14% (1.1364 => 1.1721, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.13% (1.9270 => 1.9873, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 3.12% (0.3940 => 0.4063, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.11% (4.9865 => 5.1415, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.71% (2.1791 => 2.2381, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.67% (1.3813 => 1.4182, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (3.6692 => 3.7671, std. dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6135 => 0.6297, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.62% (0.8698 => 0.8926, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.60% (0.7460 => 0.7654, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (13.2842 => 13.6218, std. dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2251, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.3819 => 1.4160, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.35% (0.4379 => 0.4482, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3872, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (6.5754 => 6.7249, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4650, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.4433 => 4.5237, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.75% (3.1889 => 3.2447, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1354, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1333 => 1.1519, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.48% (3.2742 => 3.3227, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.31% (14.5298 => 14.7204, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5188 => 1.5367, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (8.4961 => 8.5899, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7267, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5877, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.79% (7.9275 => 8.1489, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.60% (22.5627 => 21.0736, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.70% (0.3511 => 0.3381, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.6576 => 0.6463, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5766, std. dev.: 0.0148) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1054, std. dev.: 0.0232) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9066, std. dev.: 0.0597) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9833, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8614, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 02:26:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 04:26:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625092616.8A8DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1477?compare_to=1474&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1477, Order: 159127, Start Time: 2012-06-25 08:26:48, End Time: 2012-06-25 09:27:48 To: 1474, Order: 159126, Start Time: 2012-06-25 06:56:30, End Time: 2012-06-25 07:59:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (33 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 27.91% (6.9077 => 8.8354, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.56% (0.3473 => 0.3701, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.49% (0.3561 => 0.3792, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 6.43% (0.3497 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.35% (0.3543 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.35% (0.3543 => 0.3768, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 6.31% (0.3516 => 0.3738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.28% (0.3694 => 0.3926, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 5.91% (0.3927 => 0.4159, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3828 => 0.4052, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.82% (0.3886 => 0.4112, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.65% (21.9371 => 22.7372, std. dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 3.46% (10.3673 => 10.7259, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5925 => 0.6124, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.05% (0.6030 => 0.6214, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (7.9617 => 8.1870, std. dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (10.4361 => 10.7198, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (0.7433 => 0.7632, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.57% (0.7326 => 0.7514, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (7.0540 => 7.2315, std. dev.: 0.0223) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.8172 => 0.8372, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.87% (9.4845 => 9.6619, std. dev.: 0.0106) MultiSource/Applications/spiff/spiff: 1.58% (0.7835 => 0.7959, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2527, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.9449 => 5.0155, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.38% (1.5415 => 1.5628, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (4.2646 => 4.3234, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (5.0018 => 5.0644, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.21% (3.3354 => 3.3757, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8263, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.09% (2.2022 => 2.2261, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.44% (26.0924 => 26.7300, std. dev.: 0.0232) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7993, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.94% (0.8651 => 0.7272, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.50% (5.2763 => 4.7749, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.44% (2.9384 => 2.6904, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (1.1194 => 1.0427, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3403, std. dev.: 0.0215) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.08% (6.6874 => 6.4143, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -3.09% (22.1758 => 21.4901, std. dev.: 0.0222) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.14% (5.3526 => 5.2916, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.09% (5.3855 => 5.3267, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0913, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6119, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4299, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 03:50:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 05:50:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625105058.9B9222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1478?compare_to=1476&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1478, Order: 159130, Start Time: 2012-06-25 09:55:39, End Time: 2012-06-25 10:52:32 To: 1476, Order: 159127, Start Time: 2012-06-25 08:14:53, End Time: 2012-06-25 09:11:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.87% (2.0176 => 2.2974, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.26% (0.5818 => 0.6182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5748 => 0.6088, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.7038 => 0.7444, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7061 => 0.7455, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.19% (1.3693 => 1.4403, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.7710 => 0.8094, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.95% (3.9660 => 4.1623, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (1.9828 => 2.0738, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.2937 => 0.3069, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.6959 => 0.7262, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 4.23% (13.8202 => 14.4054, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2804, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9199 => 0.9563, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.4563 => 1.5107, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4390 => 0.4551, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0978, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 3.58% (16.6129 => 17.2077, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/parameter-passing: 3.40% (0.4003 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.35% (0.3578 => 0.3698, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.2193 => 1.2599, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (3.8646 => 3.9915, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5637 => 0.5822, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.3914 => 0.4042, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1491, std. dev.: 0.0189) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.1364 => 1.1734, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 3.25% (0.3789 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.24% (0.3646 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.19% (0.3663 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.19% (0.3601 => 0.3716, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3667, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.15% (1.9270 => 1.9877, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 3.15% (0.3940 => 0.4064, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.12% (0.3650 => 0.3764, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8310 => 0.8559, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2418, std. dev.: 0.0198) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.7460 => 0.7670, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (3.6692 => 3.7698, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2486, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.3819 => 1.4185, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.8698 => 0.8921, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6135 => 0.6292, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.53% (0.4379 => 0.4490, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.53% (1.3813 => 1.4163, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.2842 => 13.6184, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4791 => 0.4910, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (7.2180 => 7.3883, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.5754 => 6.7225, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.03% (4.3801 => 4.4690, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.4433 => 4.5245, std. dev.: 0.0107) MultiSource/Applications/d/make_dparser: 1.82% (3.1889 => 3.2470, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1516, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2947, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.43% (3.2742 => 3.3210, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1291, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7034, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (8.4961 => 8.5875, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4341, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 26.73% (1.8175 => 2.3034, std. dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7311, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5868, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.78% (7.9275 => 8.1481, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0786, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0195) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4116, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.59% (2.6470 => 2.5519, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.71% (9.3358 => 9.0829, std. dev.: 0.0248) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.32% (8.8259 => 8.6215, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9409, std. dev.: 0.0570) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2568, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.31% (3.0263 => 2.9868, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8581, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2504, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8451, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 03:59:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 05:59:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625105912.A2FBE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1479?compare_to=1477&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1479, Order: 159130, Start Time: 2012-06-25 09:59:45, End Time: 2012-06-25 11:00:46 To: 1477, Order: 159127, Start Time: 2012-06-25 08:26:48, End Time: 2012-06-25 09:27:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (33 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.54% (0.3473 => 0.3700, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.34% (0.3516 => 0.3739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.32% (0.3543 => 0.3767, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 6.27% (0.3543 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.26% (0.3561 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.12% (0.3694 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.88% (0.3927 => 0.4158, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3828 => 0.4050, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 5.76% (0.3886 => 0.4110, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.58% (21.9371 => 22.7217, std. dev.: 0.0308) MultiSource/Benchmarks/PAQ8p/paq8p: 3.41% (10.3673 => 10.7209, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/Hello: 3.41% (0.5925 => 0.6127, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference-object: 3.00% (0.6030 => 0.6211, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (10.4361 => 10.7240, std. dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (7.9617 => 8.1744, std. dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (0.7433 => 0.7628, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7326 => 0.7518, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.54% (7.0540 => 7.2335, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.89% (0.5569 => 0.5674, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.85% (9.4845 => 9.6601, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: 1.46% (0.7835 => 0.7949, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (4.2646 => 4.3258, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.1363 => 8.2499, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.9449 => 5.0098, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.28% (0.8067 => 0.8170, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.27% (3.3354 => 3.3777, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (5.0018 => 5.0635, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.18% (1.5415 => 1.5597, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8252, std. dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.03% (2.2022 => 2.2248, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7645, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7972, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.00% (0.8651 => 0.7267, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.46% (5.2763 => 4.7774, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (2.9384 => 2.6901, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.81% (1.1194 => 1.0432, std. dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3717, std. dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.07% (6.6874 => 6.4150, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -3.10% (22.1758 => 21.4875, std. dev.: 0.0229) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.17% (5.3526 => 5.2902, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (5.3855 => 5.3261, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0929, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6083, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 04:42:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 06:42:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625114205.D2AE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1480?compare_to=1475&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1480, Order: 159127, Start Time: 2012-06-25 09:28:03, End Time: 2012-06-25 11:43:39 To: 1475, Order: 159125, Start Time: 2012-06-25 06:43:17, End Time: 2012-06-25 09:01:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.74% (0.3488 => 0.3758, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.22% (0.3465 => 0.3715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.20% (0.3446 => 0.3694, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.17% (0.3460 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.09% (0.3442 => 0.3686, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.06% (0.3469 => 0.3714, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.98% (0.3496 => 0.3740, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.79% (0.3650 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.70% (0.3643 => 0.3887, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.53% (0.3724 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5826 => 0.6026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.5889 => 0.6079, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (0.5026 => 0.5179, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7171 => 0.7377, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (1.6211 => 1.6651, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.5900 => 0.6049, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (3.5627 => 3.6453, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.31% (1.3152 => 1.3456, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (0.4994 => 0.5107, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (0.5000 => 0.5108, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.99% (4.2109 => 4.2949, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.58% (2.0673 => 2.0999, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.52% (0.9909 => 1.0060, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (1.9966 => 2.0218, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (1.9694 => 1.9931, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.19% (23.5202 => 23.7996, std. dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (4.4195 => 4.4693, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.06% (1.5932 => 1.6101, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.73% (2.4764 => 2.4089, std. dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: -2.68% (11.9555 => 11.6349, std. dev.: 0.0105) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 05:14:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 07:14:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625121440.511822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1481?compare_to=1478&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1481, Order: 159133, Start Time: 2012-06-25 11:19:30, End Time: 2012-06-25 12:16:13 To: 1478, Order: 159130, Start Time: 2012-06-25 09:55:39, End Time: 2012-06-25 10:52:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.92% (2.0176 => 2.2985, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.5818 => 0.6183, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.02% (0.5748 => 0.6094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4328 => 0.4580, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7038 => 0.7438, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7061 => 0.7455, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 5.43% (1.3693 => 1.4437, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.95% (3.9660 => 4.1623, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.84% (0.7710 => 0.8083, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.61% (0.3580 => 0.3745, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.60% (1.9828 => 2.0740, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.5265 => 0.5504, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.41% (0.6959 => 0.7266, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.26% (13.8202 => 14.4095, std. dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9199 => 0.9556, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.77% (1.0594 => 1.0993, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3534 => 0.3665, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.53% (16.6129 => 17.1990, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.49% (1.4563 => 1.5071, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 3.45% (0.4003 => 0.4141, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5577 => 0.5766, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.38% (1.2193 => 1.2605, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.1364 => 1.1740, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (3.8646 => 3.9918, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.20% (4.9865 => 5.1461, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.13% (1.9270 => 1.9873, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/exceptions-4: 3.13% (0.3646 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.11% (0.3663 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.08% (0.3601 => 0.3712, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.97% (1.1061 => 1.1389, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4213, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (3.6692 => 3.7716, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2378, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.69% (0.6135 => 0.6300, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.65% (0.7460 => 0.7658, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.3819 => 1.4184, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2416, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (13.2842 => 13.6309, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.4791 => 0.4916, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4113 => 0.4217, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4379 => 0.4488, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.8698 => 0.8910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (7.2180 => 7.3921, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7275, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.3801 => 4.4686, std. dev.: 0.0069) MultiSource/Applications/d/make_dparser: 1.97% (3.1889 => 3.2516, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.4433 => 4.5273, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (3.2742 => 3.3240, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.50% (2.1007 => 2.1322, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (1.5188 => 1.5382, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.4961 => 8.6038, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.5298 => 14.7120, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2715, std. dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.93% (1.2998 => 1.3899, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7228, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5870, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1317, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9553, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1224, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.96% (0.3511 => 0.3372, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.8818 => 0.8609, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0961, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9542, std. dev.: 0.0202) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9828, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8578, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 05:26:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 07:26:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625122651.E02A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1482?compare_to=1479&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1482, Order: 159133, Start Time: 2012-06-25 11:27:42, End Time: 2012-06-25 12:28:25 To: 1479, Order: 159130, Start Time: 2012-06-25 09:59:45, End Time: 2012-06-25 11:00:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (35 on baseline) Performance Improvements: 0 (10 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.31% (10.7209 => 10.8609, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.20% (0.3543 => 0.3798, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.71% (0.3473 => 0.3706, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3497 => 0.3727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.52% (0.3543 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3516 => 0.3745, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.40% (0.3561 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.23% (0.3694 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.05% (0.3886 => 0.4121, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.98% (0.3927 => 0.4162, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.96% (0.3828 => 0.4056, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.76% (10.3673 => 10.8609, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.74% (21.9371 => 22.7585, std. dev.: 0.0114) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.6030 => 0.6222, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.08% (10.4361 => 10.7575, std. dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.96% (7.9617 => 8.1977, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (7.0540 => 7.2443, std. dev.: 0.0116) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7326 => 0.7521, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.8172 => 0.8348, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (9.4845 => 9.6676, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.60% (8.1363 => 8.2662, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 1.49% (0.7835 => 0.7952, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.48% (4.2646 => 4.3276, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0131, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.34% (5.7591 => 5.8364, std. dev.: 0.0092) MultiSource/Applications/d/make_dparser: 1.29% (3.3354 => 3.3784, std. dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (2.2022 => 2.2299, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.25% (0.8067 => 0.8168, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.24% (5.0018 => 5.0638, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.20% (1.5415 => 1.5600, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.10% (2.0273 => 2.0497, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.69% (26.0924 => 26.7945, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.3045 => 1.3225, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7972, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.78% (0.8651 => 0.7286, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.21% (5.2763 => 4.7902, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (2.9384 => 2.6991, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.34% (1.1194 => 1.0484, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3931, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.85% (6.6874 => 6.4299, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -2.90% (22.1758 => 21.5324, std. dev.: 0.0379) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0927, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6073, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -2.23% (1.1277 => 1.1026, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 07:24:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 09:24:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625142427.1B0512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1483?compare_to=1480&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1483, Order: 159133, Start Time: 2012-06-25 12:10:29, End Time: 2012-06-25 14:26:01 To: 1480, Order: 159127, Start Time: 2012-06-25 09:28:03, End Time: 2012-06-25 11:43:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3488 => 0.3728, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 6.76% (0.3460 => 0.3694, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 6.76% (0.3446 => 0.3679, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.70% (0.3465 => 0.3697, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3469 => 0.3699, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3442 => 0.3670, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3496 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3643 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.25% (0.3650 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.12% (0.3724 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.11% (0.5889 => 0.6072, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (0.5026 => 0.5180, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.82% (0.7171 => 0.7373, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.5900 => 0.6065, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.62% (0.4994 => 0.5125, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (1.6211 => 1.6606, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3455, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.05% (3.5627 => 3.6357, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 1.87% (4.2109 => 4.2896, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.59% (1.0781 => 1.0952, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.26% (0.9909 => 1.0034, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.20% (1.5932 => 1.6123, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (2.0673 => 2.0919, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (1.9694 => 1.9920, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (4.4195 => 4.4679, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.08% (23.5202 => 23.7751, std. dev.: 0.0152) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.00% (1.9966 => 2.0166, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.72% (11.9555 => 11.6304, std. dev.: 0.0069) Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 09:02:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 11:02:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625160220.5F5F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1484?compare_to=1481&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1484, Order: 159136, Start Time: 2012-06-25 15:07:05, End Time: 2012-06-25 16:03:53 To: 1481, Order: 159133, Start Time: 2012-06-25 11:19:30, End Time: 2012-06-25 12:16:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: 1.15% (8.5583 => 8.6568, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.5818 => 0.6180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.05% (0.5748 => 0.6096, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 5.81% (0.7038 => 0.7447, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.51% (0.7061 => 0.7450, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.46% (1.3693 => 1.4441, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2721 => 0.2868, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.33% (0.7710 => 0.8121, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.99% (3.9660 => 4.1640, std. dev.: 0.0112) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2765 => 0.2897, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.76% (0.2690 => 0.2818, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.69% (0.3580 => 0.3748, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.67% (0.5265 => 0.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.67% (1.9828 => 2.0754, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.53% (0.6959 => 0.7274, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.35% (13.8202 => 14.4207, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.20% (0.3192 => 0.3326, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2292 => 1.2806, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.98% (0.9199 => 0.9565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.79% (16.6129 => 17.2419, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.79% (1.0594 => 1.0995, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.4563 => 1.5087, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.1364 => 1.1759, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.40% (0.4003 => 0.4139, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (3.8646 => 3.9931, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (1.2193 => 1.2598, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.32% (0.5577 => 0.5762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.22% (0.3914 => 0.4040, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8310 => 0.8571, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (4.9865 => 5.1426, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 3.13% (0.3646 => 0.3760, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.10% (1.9270 => 1.9867, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.08% (1.1061 => 1.1402, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.04% (0.7506 => 0.7734, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 2.95% (0.3623 => 0.3730, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.91% (1.3819 => 1.4221, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4213, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2383, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (3.6692 => 3.7687, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6135 => 0.6301, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.69% (0.7460 => 0.7661, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.65% (0.4791 => 0.4918, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2448, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (13.2842 => 13.6304, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.8698 => 0.8919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (7.2180 => 7.3942, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.32% (6.5754 => 6.7281, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.3801 => 4.4701, std. dev.: 0.0070) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2538, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (0.6283 => 0.6405, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.4433 => 4.5271, std. dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (1.2749 => 1.2976, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.66% (1.1333 => 1.1521, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (3.2742 => 3.3236, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.43% (14.5298 => 14.7371, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (8.4961 => 8.6025, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9996 => 1.0799, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7315, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (2.8606 => 2.9697, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9189, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5865, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1268, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (4.1080 => 4.1968, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.78% (10.7476 => 10.9391, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.12% (0.4657 => 0.4279, std. dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1047, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3511 => 0.3373, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.8818 => 0.8612, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4002, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.18% (1.3780 => 1.3066, std. dev.: 0.0157) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.60% (2.6470 => 2.5518, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0977, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6052, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9208, std. dev.: 0.0622) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4986, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9860, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8621, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2451, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 09:10:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 11:10:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625161015.20DB02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1485?compare_to=1482&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1485, Order: 159136, Start Time: 2012-06-25 15:11:00, End Time: 2012-06-25 16:11:47 To: 1482, Order: 159133, Start Time: 2012-06-25 11:27:42, End Time: 2012-06-25 12:28:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (33 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (10.8609 => 11.1644, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.69% (10.3673 => 11.1644, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 7.58% (0.1622 => 0.1745, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.02% (0.3473 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3497 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3543 => 0.3747, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.76% (0.3543 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3561 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.75% (0.3516 => 0.3718, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.55% (0.3694 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.3927 => 0.4137, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.28% (0.3828 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.28% (0.3886 => 0.4091, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.73% (21.9371 => 22.7555, std. dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.6030 => 0.6232, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (10.4361 => 10.7553, std. dev.: 0.0127) SingleSource/UnitTests/ObjC++/Hello: 3.04% (0.5925 => 0.6105, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.82% (7.9617 => 8.1863, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.8172 => 0.8389, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (7.0540 => 7.2388, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.44% (0.7326 => 0.7505, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (9.4845 => 9.6790, std. dev.: 0.0128) MultiSource/Applications/spiff/spiff: 1.54% (0.7835 => 0.7956, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (2.2022 => 2.2338, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.1363 => 8.2516, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2646 => 4.3245, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.9449 => 5.0099, std. dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 1.28% (5.7591 => 5.8328, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.25% (3.3354 => 3.3770, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.22% (2.0273 => 2.0521, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (5.0018 => 5.0603, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.56% (26.0924 => 26.7601, std. dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.08% (0.8651 => 0.7260, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.97% (5.2763 => 4.8032, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.02% (2.9384 => 2.7026, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.60% (1.1194 => 1.0455, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3515, std. dev.: 0.0318) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.96% (6.6874 => 6.4229, std. dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: -3.19% (22.1758 => 21.4678, std. dev.: 0.0247) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0914, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.75% (32.5116 => 31.6172, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -2.23% (1.1277 => 1.1026, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.16% (1.4460 => 1.4292, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 10:20:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 12:20:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625172052.491562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1486?compare_to=1483&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1486, Order: 159136, Start Time: 2012-06-25 15:06:58, End Time: 2012-06-25 17:22:26 To: 1483, Order: 159133, Start Time: 2012-06-25 12:10:29, End Time: 2012-06-25 14:26:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (863 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.01% (0.3465 => 0.3708, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3446 => 0.3685, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3460 => 0.3699, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3496 => 0.3737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.89% (0.3442 => 0.3679, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3488 => 0.3727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3469 => 0.3706, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3643 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.52% (0.3650 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3724 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5826 => 0.6015, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (0.5026 => 0.5183, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.04% (0.5889 => 0.6068, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (1.6211 => 1.6646, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7171 => 0.7359, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.5900 => 0.6052, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.38% (0.4994 => 0.5113, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (3.5627 => 3.6455, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (1.3152 => 1.3445, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.00% (4.2109 => 4.2950, std. dev.: 0.0070) MultiSource/Applications/d/make_dparser: 1.44% (1.0781 => 1.0936, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.37% (2.0673 => 2.0957, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (4.4195 => 4.4793, std. dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 1.29% (0.9909 => 1.0037, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (1.9694 => 1.9945, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (1.9966 => 2.0218, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.24% (1.5932 => 1.6129, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.10% (23.5202 => 23.7794, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (2.1653 => 2.1887, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.55% (11.9555 => 11.6504, std. dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -2.46% (2.4764 => 2.4156, std. dev.: 0.0068) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 10:26:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 12:26:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625172601.ADB2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1487?compare_to=1484&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1487, Order: 159138, Start Time: 2012-06-25 16:30:50, End Time: 2012-06-25 17:27:34 To: 1484, Order: 159136, Start Time: 2012-06-25 15:07:05, End Time: 2012-06-25 16:03:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.95% (2.0176 => 2.2991, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5818 => 0.6186, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 6.00% (0.5748 => 0.6093, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.60% (0.7038 => 0.7432, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7061 => 0.7453, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.24% (1.3693 => 1.4410, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.94% (3.9660 => 4.1621, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.7710 => 0.8072, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3899 => 0.4081, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (1.9828 => 2.0738, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3107 => 0.3249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3489 => 0.3641, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.6959 => 0.7259, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 4.29% (0.3192 => 0.3329, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2292 => 1.2818, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.27% (13.8202 => 14.4099, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9199 => 0.9553, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.0594 => 1.0990, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4390 => 0.4547, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.52% (16.6129 => 17.1978, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.4563 => 1.5075, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3245 => 1.3700, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.43% (1.1364 => 1.1754, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.38% (1.2193 => 1.2605, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 3.38% (0.3789 => 0.3917, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8646 => 3.9930, std. dev.: 0.0135) SingleSource/UnitTests/ObjC/parameter-passing: 3.30% (0.4003 => 0.4135, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5637 => 0.5822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5577 => 0.5759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8310 => 0.8570, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.08% (1.1061 => 1.1402, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 3.07% (1.9270 => 1.9862, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.05% (0.3940 => 0.4060, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.03% (4.9865 => 5.1378, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-2: 3.03% (0.3601 => 0.3710, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.96% (0.7506 => 0.7728, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 2.90% (0.3623 => 0.3728, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.81% (1.3813 => 1.4201, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (3.6692 => 3.7716, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (13.2842 => 13.6502, std. dev.: 0.0246) MultiSource/Applications/siod/siod: 2.75% (2.1791 => 2.2390, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.7460 => 0.7664, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.72% (1.3819 => 1.4195, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4379 => 0.4497, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (0.6135 => 0.6298, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2419, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.4791 => 0.4914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8698 => 0.8918, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (7.2180 => 7.3959, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7273, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.3801 => 4.4694, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.96% (3.1889 => 3.2513, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (4.4433 => 4.5287, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6283 => 0.6400, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2749 => 1.2966, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1516, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.2742 => 3.3214, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.33% (14.5298 => 14.7231, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5188 => 1.5381, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (8.4961 => 8.6006, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.10% (1.8175 => 2.2737, std. dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1887, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.96% (0.9996 => 1.0792, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3932, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.89% (1.9144 => 1.9888, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7122, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.88% (11.2619 => 11.5865, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1327, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1980, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.5627 => 21.0958, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3511 => 0.3374, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.8818 => 0.8612, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.6576 => 0.6463, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (2.5089 => 2.4115, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6006, std. dev.: 0.0092) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1056, std. dev.: 0.0234) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8805, std. dev.: 0.0972) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9845, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7877, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8597, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2382, std. dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 10:37:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 12:37:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625173758.9B6B52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1488?compare_to=1485&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1488, Order: 159138, Start Time: 2012-06-25 16:38:46, End Time: 2012-06-25 17:39:31 To: 1485, Order: 159136, Start Time: 2012-06-25 15:11:00, End Time: 2012-06-25 16:11:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.37% (1.3064 => 1.3243, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 7.71% (0.1622 => 0.1747, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 7.60% (10.3673 => 11.1554, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 6.13% (0.3473 => 0.3686, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3497 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.86% (0.3516 => 0.3722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3543 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3561 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3694 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.37% (0.3927 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.33% (0.3828 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.33% (0.3886 => 0.4093, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.63% (21.9371 => 22.7336, std. dev.: 0.0272) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5925 => 0.6121, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.6030 => 0.6220, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (10.4361 => 10.7546, std. dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.71% (7.9617 => 8.1778, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7433 => 0.7633, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.60% (7.0540 => 7.2373, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 2.57% (0.7326 => 0.7514, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.8172 => 0.8366, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (9.4845 => 9.6709, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: 1.85% (0.7835 => 0.7980, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2527, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (2.2022 => 2.2329, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (4.2646 => 4.3210, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.9449 => 5.0097, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 1.26% (2.0273 => 2.0528, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.26% (3.3354 => 3.3773, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.25% (5.7591 => 5.8313, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (5.0018 => 5.0644, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.08% (1.5415 => 1.5582, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7683, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.52% (1.3045 => 1.3243, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.06% (0.8651 => 0.7262, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.01% (5.2763 => 4.8008, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (2.9384 => 2.6982, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.60% (1.1194 => 1.0455, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3282, std. dev.: 0.0348) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.02% (6.6874 => 6.4187, std. dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: -3.05% (22.1758 => 21.4998, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0929, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6095, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 11:49:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 13:49:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625184956.81CBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1489?compare_to=1487&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1489, Order: 159146, Start Time: 2012-06-25 17:54:44, End Time: 2012-06-25 18:51:29 To: 1487, Order: 159138, Start Time: 2012-06-25 16:30:50, End Time: 2012-06-25 17:27:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5818 => 0.6166, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.95% (0.2721 => 0.2883, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 5.76% (0.5748 => 0.6079, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.64% (0.7038 => 0.7435, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.34% (0.4328 => 0.4559, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7061 => 0.7437, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 5.08% (1.3693 => 1.4388, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.77% (3.9660 => 4.1550, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 4.65% (0.4062 => 0.4251, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2761 => 0.2879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3022 => 0.3150, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.23% (0.3899 => 0.4064, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.6959 => 0.7250, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2781 => 0.2897, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.13% (13.8202 => 14.3915, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2726 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2765 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3485 => 0.3623, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2760 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.88% (0.2782 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.87% (1.9828 => 2.0595, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 3.84% (0.2607 => 0.2707, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.2937 => 0.3049, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2690 => 0.2791, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9199 => 0.9543, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2735, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 3.51% (0.3192 => 0.3304, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3293 => 0.3408, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.48% (16.6129 => 17.1911, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.4563 => 1.5054, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.31% (3.8646 => 3.9924, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.23% (0.3868 => 0.3993, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.22% (1.1364 => 1.1730, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3245 => 1.3670, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.2193 => 1.2576, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 3.07% (0.4003 => 0.4126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.07% (0.5577 => 0.5748, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.99% (1.1061 => 1.1392, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4390 => 0.4521, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1345, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 2.96% (0.3578 => 0.3684, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.93% (1.9270 => 1.9834, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.89% (0.7506 => 0.7723, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.88% (0.3650 => 0.3755, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 2.85% (0.3789 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.84% (0.3914 => 0.4025, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (13.2842 => 13.6562, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 2.74% (0.3646 => 0.3746, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.72% (0.3940 => 0.4047, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.66% (2.1791 => 2.2371, std. dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2268, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7602, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4157, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.44% (0.4379 => 0.4486, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.41% (1.3813 => 1.4146, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.38% (7.2180 => 7.3897, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7259, std. dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.8698 => 0.8881, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.99% (3.1889 => 3.2523, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4651, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5242, std. dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 1.81% (1.2749 => 1.2980, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4682, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3150, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.5188 => 1.5366, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.5298 => 14.6971, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (8.4961 => 8.5908, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std. dev.: 0.0475) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3953, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7304, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.06% (7.9275 => 8.1699, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.89% (11.2619 => 11.5872, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.17% (4.1080 => 4.1971, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0706, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (2.5089 => 2.4114, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6024, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1047, std. dev.: 0.0156) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9850, std. dev.: 0.0398) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2594, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9831, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2291, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7866, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8584, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 12:05:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 14:05:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625190555.84EE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1490?compare_to=1488&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1490, Order: 159147, Start Time: 2012-06-25 18:06:37, End Time: 2012-06-25 19:07:26 To: 1488, Order: 159138, Start Time: 2012-06-25 16:38:46, End Time: 2012-06-25 17:39:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (36 on baseline) Performance Improvements: 1 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.48% (11.1554 => 10.8784, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.86% (0.3543 => 0.3786, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.56% (0.3473 => 0.3701, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.34% (0.3516 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.32% (0.3543 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.26% (0.3561 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.06% (0.3694 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.3828 => 0.4051, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.81% (0.3927 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.74% (0.3886 => 0.4109, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.93% (10.3673 => 10.8784, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 3.88% (0.5925 => 0.6155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.86% (0.6030 => 0.6263, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.63% (21.9371 => 22.7328, std. dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.24% (7.0540 => 7.2828, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (10.4361 => 10.7584, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference: 3.06% (0.7326 => 0.7550, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.01% (7.9617 => 8.2011, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.50% (0.8172 => 0.8376, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.16% (2.2022 => 2.2498, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (9.4845 => 9.6768, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 1.85% (1.2842 => 1.3079, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (4.9449 => 5.0228, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0665 => 2.0964, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.36% (8.1363 => 8.2471, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.29% (4.2646 => 4.3198, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.26% (3.3354 => 3.3774, std. dev.: 0.0148) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8306, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.5415 => 1.5599, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (5.0018 => 5.0589, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.01% (2.0273 => 2.0478, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7410, std. dev.: 0.0353) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8003, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.09% (0.8651 => 0.7259, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (5.2763 => 4.7990, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.04% (2.9384 => 2.7021, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.93% (1.1194 => 1.0530, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3300, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.03% (6.6874 => 6.4176, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -2.93% (22.1758 => 21.5269, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0925, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6090, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -2.22% (1.1277 => 1.1027, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4313, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 13:03:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 15:03:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625200315.9825B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1491?compare_to=1486&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1491, Order: 159146, Start Time: 2012-06-25 17:49:21, End Time: 2012-06-25 20:04:48 To: 1486, Order: 159136, Start Time: 2012-06-25 15:06:58, End Time: 2012-06-25 17:22:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.90% (0.3792 => 0.4395, std. dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3446 => 0.3691, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3465 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.02% (0.3488 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.99% (0.3460 => 0.3702, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.97% (0.3442 => 0.3682, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 6.95% (0.3469 => 0.3710, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 6.86% (0.3496 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3643 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.58% (0.3650 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.36% (0.3724 => 0.3961, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.47% (0.5826 => 0.6028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.19% (0.5889 => 0.6077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.68% (0.7171 => 0.7363, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (0.5026 => 0.5158, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.5900 => 0.6044, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (1.6211 => 1.6580, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (3.5627 => 3.6406, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (0.4994 => 0.5101, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (1.3152 => 1.3402, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.71% (4.2109 => 4.2829, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (2.0673 => 2.0998, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.54% (0.9909 => 1.0062, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.14% (1.9694 => 1.9918, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (1.9966 => 2.0179, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.62% (11.9555 => 11.6426, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.58% (2.4764 => 2.4124, std. dev.: 0.0162) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 13:13:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 15:13:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625201340.000892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1492?compare_to=1489&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1492, Order: 159152, Start Time: 2012-06-25 19:18:27, End Time: 2012-06-25 20:15:13 To: 1489, Order: 159146, Start Time: 2012-06-25 17:54:44, End Time: 2012-06-25 18:51:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (2.0595 => 2.0853, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4114 => 2.4466, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5818 => 0.6240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5748 => 0.6153, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.50% (0.7061 => 0.7520, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (0.7038 => 0.7421, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.32% (1.3693 => 1.4421, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (1.9828 => 2.0853, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1511, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2292 => 1.2836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.90% (13.8202 => 14.3588, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.78% (0.4390 => 0.4556, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.72% (0.3578 => 0.3711, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.65% (0.3646 => 0.3779, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.64% (0.3601 => 0.3732, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.4563 => 1.5088, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 3.60% (0.3663 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.60% (0.4003 => 0.4147, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.59% (0.3789 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.47% (0.3914 => 0.4050, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 3.42% (0.3623 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.40% (0.3650 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.32% (0.3940 => 0.4071, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.28% (16.6129 => 17.1583, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2193 => 1.2556, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.94% (0.7506 => 0.7727, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (3.8646 => 3.9775, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.87% (1.1364 => 1.1690, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.3819 => 1.4180, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1160, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.59% (1.9270 => 1.9770, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (3.6692 => 3.7639, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.52% (1.3813 => 1.4161, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2034, std. dev.: 0.0151) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5950, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (7.2180 => 7.3774, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2246, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (6.5754 => 6.7037, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.3801 => 4.4552, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2422, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.4433 => 4.5157, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1333 => 1.1494, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.06% (14.5298 => 14.6834, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.00% (8.4961 => 8.5813, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0531) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1879, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4037, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7396, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.83% (2.8606 => 2.9701, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 3.41% (11.2619 => 11.6455, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1377, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1981, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9524, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8660, std. dev.: 0.0211) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0293, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.37% (0.9108 => 0.8983, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5883, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0974, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9508, std. dev.: 0.0388) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.77% (0.8342 => 0.8194, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2236, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0169) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.39% (3.0263 => 2.9842, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (9.9194 => 9.7881, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.30% (28.2225 => 27.8569, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 13:33:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 15:33:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625203355.CBCE22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1493?compare_to=1490&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1493, Order: 159152, Start Time: 2012-06-25 19:34:30, End Time: 2012-06-25 20:35:30 To: 1490, Order: 159147, Start Time: 2012-06-25 18:06:37, End Time: 2012-06-25 19:07:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 3 (31 on baseline) Performance Improvements: 3 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 867 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.22% (10.8784 => 11.0115, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 2.02% (1.1027 => 1.1250, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4112 => 2.4463, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.30% (0.4560 => 0.3908, std. dev.: 0.0148) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.25% (5.3516 => 5.2846, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: -1.66% (1.3677 => 1.3450, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.77% (0.3473 => 0.3708, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3561 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.61% (0.3497 => 0.3728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3516 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3543 => 0.3776, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.55% (0.3543 => 0.3775, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3694 => 0.3933, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 6.21% (10.3673 => 11.0115, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 6.10% (0.3886 => 0.4123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3828 => 0.4059, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3927 => 0.4161, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.47% (0.5925 => 0.6190, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.38% (0.6030 => 0.6294, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.58% (0.7326 => 0.7588, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 3.32% (21.9371 => 22.6663, std. dev.: 0.0181) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (10.4361 => 10.7414, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.8172 => 0.8407, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.56% (7.9617 => 8.1655, std. dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: 2.52% (0.7433 => 0.7620, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (7.0540 => 7.2259, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.48% (1.2842 => 1.3032, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (9.4845 => 9.6182, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: 1.37% (0.7835 => 0.7942, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (2.2022 => 2.2314, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.31% (1.5415 => 1.5617, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.1363 => 8.2379, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (2.0665 => 2.0912, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (4.2646 => 4.3082, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7784, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.27% (11.6436 => 11.7911, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.95% (0.8651 => 0.7271, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.25% (5.2763 => 4.7883, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.02% (2.9384 => 2.7026, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (1.1194 => 1.0469, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -5.14% (54.1659 => 51.3793, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.32% (6.6874 => 6.3983, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -3.12% (22.1758 => 21.4831, std. dev.: 0.0195) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.87% (5.3855 => 5.2846, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.18% (1.7609 => 1.7401, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.03% (5.3526 => 5.2973, std. dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0917, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.75% (32.5116 => 31.6167, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.66% (1.3677 => 1.3450, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 14:37:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 16:37:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625213731.36B1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1494?compare_to=1492&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1494, Order: 159157, Start Time: 2012-06-25 20:42:18, End Time: 2012-06-25 21:39:04 To: 1492, Order: 159152, Start Time: 2012-06-25 19:18:27, End Time: 2012-06-25 20:15:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.62% (2.0176 => 2.2924, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5748 => 0.6164, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5818 => 0.6231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.60% (0.7061 => 0.7527, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (0.7038 => 0.7421, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.24% (1.3693 => 1.4410, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.7710 => 0.8111, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.9828 => 2.0803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.58% (3.9660 => 4.1475, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2825, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.5265 => 0.5493, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.20% (0.3192 => 0.3326, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3750, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 3.69% (0.3578 => 0.3710, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.65% (0.4003 => 0.4149, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.62% (0.3789 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.54% (0.3646 => 0.3775, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.53% (0.3601 => 0.3728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.49% (0.3663 => 0.3791, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.47% (0.3914 => 0.4050, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9199 => 0.9515, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.40% (0.3650 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.37% (0.3623 => 0.3745, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.4563 => 1.5051, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 3.32% (0.3940 => 0.4071, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.29% (16.6129 => 17.1598, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2551, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5577 => 0.5736, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9730, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.61% (1.1061 => 1.1350, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.58% (0.7506 => 0.7700, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9765, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.53% (1.3813 => 1.4162, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1111, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (3.6692 => 3.7590, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.3819 => 1.4156, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.22% (14.8535 => 15.1831, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5750, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.8698 => 0.8886, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.09% (7.2180 => 7.3689, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7008, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.3801 => 4.4524, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5165, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.56% (3.1889 => 3.2385, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4071, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7189, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (2.8606 => 2.9697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.78% (12.4560 => 12.9272, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.41% (11.2619 => 11.6462, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1402, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.18% (4.1080 => 4.1976, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9706, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2308 => 1.2437, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.49% (0.4657 => 0.4029, std. dev.: 0.0147) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (22.5627 => 21.0063, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.42% (0.9108 => 0.8979, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -2.70% (9.3358 => 9.0835, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9606, std. dev.: 0.0441) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5141, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (0.8342 => 0.8195, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2200, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2607, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7870, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.30% (3.0263 => 2.9869, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8590, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8464, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 15:01:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 17:01:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625220145.4323B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1495?compare_to=1493&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1495, Order: 159157, Start Time: 2012-06-25 21:02:30, End Time: 2012-06-25 22:03:18 To: 1493, Order: 159152, Start Time: 2012-06-25 19:34:30, End Time: 2012-06-25 20:35:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (36 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 7.42% (0.3908 => 0.4198, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (11.0115 => 11.1217, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 9.98% (0.3817 => 0.4198, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3543 => 0.3806, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.28% (10.3673 => 11.1217, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3473 => 0.3716, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3497 => 0.3734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3543 => 0.3783, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: 6.68% (0.3561 => 0.3799, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.42% (0.3694 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.27% (0.3828 => 0.4068, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.18% (0.3886 => 0.4126, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.14% (0.3927 => 0.4168, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.63% (0.6030 => 0.6309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.5925 => 0.6185, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.52% (0.7326 => 0.7584, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 3.45% (21.9371 => 22.6950, std. dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (10.4361 => 10.7603, std. dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (7.9617 => 8.1687, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.55% (0.8172 => 0.8380, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7433 => 0.7622, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (7.0540 => 7.2246, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.2842 => 1.3039, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (2.2022 => 2.2341, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6191, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: 1.37% (0.7835 => 0.7942, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (2.0665 => 2.0923, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (8.1363 => 8.2370, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.2646 => 4.3162, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.9449 => 4.9982, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.06% (1.5415 => 1.5579, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 1.03% (3.3354 => 3.3696, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.0018 => 5.0529, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7966, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.29% (11.6436 => 11.7935, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.14% (0.8651 => 0.7255, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (5.2763 => 4.7907, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (2.9384 => 2.6946, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (1.1194 => 1.0464, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3629, std. dev.: 0.0235) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.38% (6.6874 => 6.3942, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -3.11% (22.1758 => 21.4851, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (5.3855 => 5.2867, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0930, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6117, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3451, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 15:45:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 17:45:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120625224537.D94D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1496?compare_to=1491&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1496, Order: 159157, Start Time: 2012-06-25 20:31:45, End Time: 2012-06-25 22:47:12 To: 1491, Order: 159146, Start Time: 2012-06-25 17:49:21, End Time: 2012-06-25 20:04:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (33 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 890 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.65% (0.6077 => 0.6177, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 1.63% (0.7363 => 0.7483, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (2.0998 => 2.1299, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 1.22% (1.0062 => 1.0185, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.74% (0.3792 => 0.4351, std. dev.: 0.0198) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3446 => 0.3738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3465 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3469 => 0.3756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.24% (0.3460 => 0.3745, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.23% (0.3488 => 0.3775, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3442 => 0.3725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3496 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3643 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.64% (0.3650 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3724 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.05% (0.5826 => 0.6120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.89% (0.5889 => 0.6177, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.35% (0.7171 => 0.7483, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.03% (2.0673 => 2.1299, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.79% (0.9909 => 1.0185, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (1.6211 => 1.6608, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (0.5026 => 0.5147, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.23% (3.5627 => 3.6421, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (1.3152 => 1.3424, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 1.82% (4.2109 => 4.2874, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.6435 => 0.6542, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (1.9694 => 1.9931, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.18% (23.5202 => 23.7970, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 1.15% (0.9697 => 0.9809, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.07% (1.0781 => 1.0896, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (1.9966 => 2.0168, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.06% (0.2122 => 0.2293, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.25% (2.4764 => 2.3958, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.4253 => 0.4143, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -2.34% (11.9555 => 11.6763, std. dev.: 0.0129) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 16:01:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 18:01:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120625230116.7F30A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1497?compare_to=1494&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1497, Order: 159162, Start Time: 2012-06-25 22:05:59, End Time: 2012-06-25 23:02:49 To: 1494, Order: 159157, Start Time: 2012-06-25 20:42:18, End Time: 2012-06-25 21:39:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.77% (1.4071 => 1.3822, std. dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.77% (2.0176 => 2.2955, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.86% (0.5818 => 0.6159, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5748 => 0.6073, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7061 => 0.7435, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.7710 => 0.8109, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.00% (0.2782 => 0.2921, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.88% (1.3693 => 1.4361, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2607 => 0.2732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2655 => 0.2780, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.56% (3.9660 => 4.1469, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2726 => 0.2850, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (1.9828 => 2.0728, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.42% (0.2760 => 0.2882, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.38% (0.2765 => 0.2886, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3489 => 0.3639, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 4.16% (0.3578 => 0.3727, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.5265 => 0.5482, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 4.06% (0.3789 => 0.3943, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.02% (0.2988 => 0.3108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.95% (0.3646 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.95% (0.4003 => 0.4161, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.94% (0.3601 => 0.3743, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.6959 => 0.7233, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 3.93% (0.3663 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.88% (0.3914 => 0.4066, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.84% (0.3623 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.81% (0.3650 => 0.3789, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.80% (13.8202 => 14.3456, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 3.65% (0.3940 => 0.4084, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4390 => 0.4549, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.3756 => 0.3889, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.44% (0.3868 => 0.4001, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.4563 => 1.5039, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2562, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (1.1364 => 1.1700, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3630, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.84% (1.3819 => 1.4212, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.76% (0.5577 => 0.5731, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (3.8646 => 3.9702, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0655, std. dev.: 0.0244) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.63% (1.3813 => 1.4176, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.63% (1.9270 => 1.9776, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1348, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (3.6692 => 3.7598, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2131, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.9865 => 5.1067, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.2842 => 13.5934, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (7.2180 => 7.3803, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.5754 => 6.7083, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8698 => 0.8865, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2192, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.3801 => 4.4597, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.4433 => 4.5170, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.59% (3.1889 => 3.2396, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 1.18% (14.5298 => 14.7009, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0527) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7350, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.42% (11.2619 => 11.6465, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.92% (7.9275 => 8.1590, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (4.1080 => 4.1985, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9540, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9721, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3511 => 0.3374, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.04% (0.8818 => 0.8638, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.53% (1.0460 => 0.8626, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std. dev.: 0.0127) MultiSource/Applications/minisat/minisat: -2.51% (9.3358 => 9.1013, std. dev.: 0.0384) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4867 => 0.4762, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9553, std. dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2224, std. dev.: 0.0083) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9819, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8610, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 16:29:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 18:29:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120625232956.F18ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1498?compare_to=1495&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1498, Order: 159167, Start Time: 2012-06-25 22:30:30, End Time: 2012-06-25 23:31:30 To: 1495, Order: 159157, Start Time: 2012-06-25 21:02:30, End Time: 2012-06-25 22:03:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (39 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (11.1217 => 11.2928, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (7.2246 => 7.3236, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.93% (10.3673 => 11.2928, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 7.31% (0.3473 => 0.3727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.21% (0.3497 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.11% (0.3543 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.08% (0.3543 => 0.3794, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.08% (0.3561 => 0.3813, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.82% (0.3694 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.50% (0.3828 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.3927 => 0.4181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.43% (0.3886 => 0.4136, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.83% (21.9371 => 22.7783, std. dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3236, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference-object: 3.57% (0.6030 => 0.6245, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (10.4361 => 10.8080, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/Hello: 3.46% (0.5925 => 0.6130, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (7.9617 => 8.2111, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7433 => 0.7644, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.8172 => 0.8403, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7326 => 0.7513, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.40% (2.2022 => 2.2551, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.06% (9.4845 => 9.6795, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 1.77% (0.7835 => 0.7974, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (4.9449 => 5.0241, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (8.1363 => 8.2619, std. dev.: 0.0075) MultiSource/Applications/hbd/hbd: 1.52% (1.5603 => 1.5840, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (4.2646 => 4.3236, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.34% (5.7591 => 5.8365, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.29% (5.0018 => 5.0662, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.26% (1.5415 => 1.5609, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.26% (3.3354 => 3.3773, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (2.0665 => 2.0880, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7418, std. dev.: 0.0222) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.27% (11.6436 => 11.7911, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.57% (0.8651 => 0.7304, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.03% (5.2763 => 4.7999, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (2.9384 => 2.7130, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.01% (1.1194 => 1.0521, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3563, std. dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.50% (6.6874 => 6.3864, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -2.87% (22.1758 => 21.5385, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.15% (5.3855 => 5.3235, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.06% (12.4730 => 12.0919, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.78% (32.5116 => 31.6093, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3451, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4306, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 17:26:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 19:26:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626002644.D465B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1499?compare_to=1497&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1499, Order: 159173, Start Time: 2012-06-25 23:31:35, End Time: 2012-06-26 00:28:18 To: 1497, Order: 159162, Start Time: 2012-06-25 22:05:59, End Time: 2012-06-25 23:02:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.00% (2.0176 => 2.3001, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.85% (0.5748 => 0.6084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.5818 => 0.6158, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7061 => 0.7438, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 4.99% (0.7038 => 0.7389, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.94% (1.3693 => 1.4369, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (3.9660 => 4.1495, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.7710 => 0.8064, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4062 => 0.4244, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.28% (0.2781 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5265 => 0.5484, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.11% (0.2655 => 0.2764, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.09% (0.3107 => 0.3234, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2760 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.05% (0.2690 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.02% (0.2937 => 0.3055, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (1.9828 => 2.0620, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.97% (13.8202 => 14.3682, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.91% (0.2765 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.85% (0.3580 => 0.3718, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3899 => 0.4043, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.69% (0.6959 => 0.7216, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2739, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.56% (0.4016 => 0.4159, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (0.3756 => 0.3884, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0102) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.4563 => 1.5038, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3868 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.10% (0.3650 => 0.3763, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 3.08% (0.3601 => 0.3712, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.03% (0.3663 => 0.3774, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.2193 => 1.2560, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.89% (0.7506 => 0.7723, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 2.84% (0.3940 => 0.4052, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (1.3819 => 1.4207, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9678, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2453, std. dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0427, std. dev.: 0.0164) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.56% (1.3813 => 1.4166, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.54% (1.1061 => 1.1342, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.51% (1.9270 => 1.9754, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (13.2842 => 13.6167, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7588, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.43% (4.9865 => 5.1076, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (7.2180 => 7.3836, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.11% (6.5754 => 6.7144, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.80% (4.3801 => 4.4588, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.8698 => 0.8854, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2453, std. dev.: 0.0101) MultiSource/Applications/siod/siod: 1.73% (2.1791 => 2.2167, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.4433 => 4.5159, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.1333 => 1.1484, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.5298 => 14.6867, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.22% (1.8175 => 2.2941, std. dev.: 0.0379) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7259, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.83% (2.8606 => 2.9701, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.42% (11.2619 => 11.6465, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.94% (7.9275 => 8.1606, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1980, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0208, std. dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3511 => 0.3374, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.02% (0.8818 => 0.8640, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5922, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1052, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9821, std. dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7649, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2209, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9854, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (9.9194 => 9.7880, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 17:57:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 19:57:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626005752.509C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1500?compare_to=1498&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1500, Order: 159174, Start Time: 2012-06-25 23:58:34, End Time: 2012-06-26 00:59:25 To: 1498, Order: 159167, Start Time: 2012-06-25 22:30:30, End Time: 2012-06-25 23:31:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (12 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.72% (10.3673 => 11.2709, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3543 => 0.3833, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3473 => 0.3738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.46% (0.3497 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3516 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.37% (0.3543 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.33% (0.3561 => 0.3822, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.79% (0.3828 => 0.4088, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.75% (0.3927 => 0.4192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.72% (0.3886 => 0.4147, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.94% (21.9371 => 22.8010, std. dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (7.0540 => 7.3101, std. dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.4361 => 10.8084, std. dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.20% (7.9617 => 8.2166, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.6030 => 0.6220, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 3.12% (0.5925 => 0.6110, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.08% (0.8172 => 0.8424, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.81% (0.7433 => 0.7642, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4615 => 0.4726, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.35% (2.2022 => 2.2539, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.24% (0.7326 => 0.7490, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (9.4845 => 9.6900, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.68% (8.1363 => 8.2727, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 1.67% (1.5603 => 1.5864, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2842 => 1.3051, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.57% (0.7835 => 0.7958, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.2646 => 4.3270, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.45% (1.5415 => 1.5639, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (4.9449 => 5.0147, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (2.0665 => 2.0955, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (5.0018 => 5.0716, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 1.35% (5.7591 => 5.8367, std. dev.: 0.0139) MultiSource/Applications/d/make_dparser: 1.30% (3.3354 => 3.3788, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.07% (2.0273 => 2.0489, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.49% (26.0924 => 26.7423, std. dev.: 0.0306) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7945, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.65% (0.8651 => 0.7297, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.07% (5.2763 => 4.7978, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (2.9384 => 2.7117, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.21% (1.1194 => 1.0499, std. dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3632, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.48% (6.6874 => 6.3880, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -2.97% (22.1758 => 21.5163, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.14% (5.3855 => 5.3243, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0928, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6108, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.66% (1.3677 => 1.3450, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 18:27:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 20:27:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626012754.1B6182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1501?compare_to=1496&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1501, Order: 159171, Start Time: 2012-06-25 23:14:06, End Time: 2012-06-26 01:29:28 To: 1496, Order: 159157, Start Time: 2012-06-25 20:31:45, End Time: 2012-06-25 22:47:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (23 on baseline) Performance Improvements: 5 (2 on baseline) Unchanged Tests: 889 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.6120 => 0.6006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.67% (0.6177 => 0.6074, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.60% (2.1299 => 2.0958, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -1.54% (0.7483 => 0.7368, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -1.48% (1.0185 => 1.0034, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.80% (0.3792 => 0.4467, std. dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions-2: 7.02% (0.3446 => 0.3688, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.01% (0.3465 => 0.3708, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3442 => 0.3680, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3488 => 0.3727, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3460 => 0.3697, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3469 => 0.3706, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.72% (0.3496 => 0.3731, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.48% (0.3643 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.41% (0.3650 => 0.3884, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.26% (0.3724 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.14% (0.5889 => 0.6074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.09% (0.5826 => 0.6006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.75% (0.7171 => 0.7368, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.5900 => 0.6039, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (0.5026 => 0.5143, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.16% (1.6211 => 1.6561, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.95% (3.5627 => 3.6321, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.66% (4.2109 => 4.2809, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (1.3152 => 1.3339, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (2.0673 => 2.0958, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.26% (0.9909 => 1.0034, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (1.9694 => 1.9893, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.03% (11.9555 => 11.5934, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -2.54% (2.4764 => 2.4136, std. dev.: 0.0154) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 18:50:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 20:50:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626015026.0344F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1502?compare_to=1499&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1502, Order: 159176, Start Time: 2012-06-26 00:55:19, End Time: 2012-06-26 01:51:59 To: 1499, Order: 159173, Start Time: 2012-06-25 23:31:35, End Time: 2012-06-26 00:28:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.54% (1.3719 => 1.3930, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.76% (0.4326 => 0.3947, std. dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3033, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.5818 => 0.6176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5748 => 0.6088, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7061 => 0.7448, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (0.4328 => 0.4544, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4374, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.72% (3.9660 => 4.1530, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5265 => 0.5486, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.19% (0.4062 => 0.4232, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.14% (0.3022 => 0.3147, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2781 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.07% (0.2607 => 0.2713, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.02% (13.8202 => 14.3762, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2966 => 0.3084, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.94% (0.2690 => 0.2796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3149 => 0.3271, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2765 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.82% (0.3899 => 0.4048, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2760 => 0.2865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.77% (0.3580 => 0.3715, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (1.9828 => 2.0569, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2761 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.2292 => 1.2728, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.51% (0.3192 => 0.3304, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0594 => 1.0961, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5065, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3453 => 0.3570, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.4016 => 0.4152, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.10% (0.3578 => 0.3689, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3534 => 0.3643, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.05% (0.4003 => 0.4125, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 3.04% (0.3789 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.03% (0.3601 => 0.3710, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 2.98% (0.3663 => 0.3772, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1702, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 2.94% (0.3914 => 0.4029, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.88% (0.3650 => 0.3755, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.85% (1.3819 => 1.4213, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.84% (1.3245 => 1.3621, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 2.76% (0.3623 => 0.3723, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (3.8646 => 3.9703, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.72% (1.3813 => 1.4189, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 2.72% (0.3940 => 0.4047, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.68% (0.7506 => 0.7707, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.61% (16.6129 => 17.0462, std. dev.: 0.0149) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9766, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2270, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.2842 => 13.6126, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (3.6692 => 3.7581, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (4.9865 => 5.1023, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3814, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.7460 => 0.7621, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.5754 => 6.7167, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6135 => 0.6266, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2196, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.86% (4.3801 => 4.4614, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 1.75% (3.1889 => 3.2447, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.8698 => 0.8842, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5164, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1333 => 1.1493, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.09% (14.5298 => 14.6888, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 27.27% (1.8175 => 2.3131, std. dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.17% (1.2998 => 1.3930, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7366, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9694, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.40% (11.2619 => 11.6450, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.86% (7.9275 => 8.1545, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.22% (4.1080 => 4.1992, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9590, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2450, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.25% (0.4657 => 0.3947, std. dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0122, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.06% (0.8818 => 0.8636, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (0.9108 => 0.8984, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.0460 => 0.8625, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5955, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1003, std. dev.: 0.0185) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0037, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2572, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4905, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9859, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8590, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 19:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 21:25:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626022544.988B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1503?compare_to=1500&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1503, Order: 159178, Start Time: 2012-06-26 01:26:27, End Time: 2012-06-26 02:27:18 To: 1500, Order: 159174, Start Time: 2012-06-25 23:58:34, End Time: 2012-06-26 00:59:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (11.2709 => 11.5256, std. dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.17% (10.3673 => 11.5256, std. dev.: 0.0161) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.49% (0.3497 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3516 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.39% (0.3543 => 0.3805, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.09% (0.3694 => 0.3956, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3828 => 0.4092, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3927 => 0.4195, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.77% (0.3886 => 0.4149, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.93% (21.9371 => 22.7988, std. dev.: 0.0145) SingleSource/UnitTests/ObjC++/property-reference-object: 3.76% (0.6030 => 0.6257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.71% (0.5925 => 0.6145, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (7.0540 => 7.3139, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (10.4361 => 10.8188, std. dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.19% (7.9617 => 8.2156, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.70% (0.7433 => 0.7634, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.70% (0.7326 => 0.7524, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.45% (2.2022 => 2.2561, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.23% (0.4615 => 0.4718, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (0.8172 => 0.8338, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (9.4845 => 9.6731, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3043, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.50% (8.1363 => 8.2583, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (4.2646 => 4.3233, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (4.9449 => 5.0121, std. dev.: 0.0098) MultiSource/Applications/hbd/hbd: 1.33% (1.5603 => 1.5810, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (5.0018 => 5.0666, std. dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 1.26% (5.7591 => 5.8318, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.20% (3.3354 => 3.3753, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.11% (2.0665 => 2.0894, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7795, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.28% (11.6436 => 11.7922, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.56% (0.8651 => 0.7305, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.98% (5.2763 => 4.8027, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (2.9384 => 2.7107, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.17% (1.1194 => 1.0503, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3636, std. dev.: 0.0248) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3896, std. dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: -2.98% (22.1758 => 21.5140, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.12% (5.3855 => 5.3250, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0926, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.75% (32.5116 => 31.6160, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3451, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 20:14:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 22:14:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626031410.98F4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1504?compare_to=1502&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1504, Order: 159179, Start Time: 2012-06-26 02:18:56, End Time: 2012-06-26 03:15:44 To: 1502, Order: 159176, Start Time: 2012-06-26 00:55:19, End Time: 2012-06-26 01:51:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.11% (3.8948 => 3.7738, std. dev.: 0.0363) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5818 => 0.6179, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.07% (0.5748 => 0.6097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7061 => 0.7459, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7038 => 0.7392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (0.4328 => 0.4545, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.93% (1.3693 => 1.4368, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.7710 => 0.8089, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1505, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.4062 => 0.4248, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.28% (0.2781 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3022 => 0.3150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.14% (0.2607 => 0.2715, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.14% (0.5265 => 0.5483, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.09% (0.2690 => 0.2800, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2628 => 0.2735, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2966 => 0.3086, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2655 => 0.2761, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3107 => 0.3231, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.97% (0.3149 => 0.3274, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.94% (1.9828 => 2.0609, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 3.92% (0.2937 => 0.3052, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2760 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.91% (0.2765 => 0.2873, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.85% (13.8202 => 14.3518, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3489 => 0.3623, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2761 => 0.2866, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.80% (0.3580 => 0.3716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.77% (0.3899 => 0.4046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.6959 => 0.7213, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (0.3485 => 0.3612, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.63% (0.3192 => 0.3308, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.2292 => 1.2729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.51% (0.4016 => 0.4157, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.45% (0.3453 => 0.3572, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3293 => 0.3406, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.41% (0.3578 => 0.3700, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.40% (0.3646 => 0.3770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 3.35% (0.3789 => 0.3916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5049, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 3.30% (0.4003 => 0.4135, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.3914 => 0.4042, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.25% (0.3601 => 0.3718, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.22% (0.3663 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.21% (0.3650 => 0.3767, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 3.17% (0.3623 => 0.3738, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.0594 => 1.0930, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.08% (0.3868 => 0.3987, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.4390 => 0.4519, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (3.8646 => 3.9747, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (1.3245 => 1.3604, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.63% (1.3813 => 1.4176, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0426, std. dev.: 0.0206) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4172, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.54% (1.9270 => 1.9759, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (13.2842 => 13.6042, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (3.6692 => 3.7559, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (4.9865 => 5.1042, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2021, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3814, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.97% (6.5754 => 6.7048, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.8698 => 0.8848, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.3801 => 4.4549, std. dev.: 0.0096) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2160, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2422, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.4433 => 4.5159, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.24% (14.5298 => 14.7095, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0528) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.96% (0.9996 => 1.0792, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7256, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.42% (11.2619 => 11.6466, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1281, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.17% (4.1080 => 4.1971, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8656, std. dev.: 0.0389) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.03% (22.5627 => 20.9758, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.33% (0.3511 => 0.3359, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.11% (0.8818 => 0.8632, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5920, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.32% (9.3358 => 9.1189, std. dev.: 0.0280) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9811, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (0.8342 => 0.8195, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2254, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9834, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7872, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8613, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 20:53:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 22:53:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626035359.2745E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1505?compare_to=1503&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1505, Order: 159179, Start Time: 2012-06-26 02:54:25, End Time: 2012-06-26 03:55:33 To: 1503, Order: 159178, Start Time: 2012-06-26 01:26:27, End Time: 2012-06-26 02:27:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (11 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 10.80% (10.3673 => 11.4866, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3473 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3543 => 0.3814, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3561 => 0.3833, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3516 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3543 => 0.3811, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3694 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3828 => 0.4095, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.88% (0.3927 => 0.4197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.85% (0.3886 => 0.4152, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.80% (21.9371 => 22.7700, std. dev.: 0.0201) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5925 => 0.6148, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.70% (0.6030 => 0.6253, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (10.4361 => 10.8080, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (7.0540 => 7.2971, std. dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.20% (7.9617 => 8.2165, std. dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7326 => 0.7525, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (0.8172 => 0.8375, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 2.45% (0.7433 => 0.7615, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (2.2022 => 2.2463, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (9.4845 => 9.6714, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.9449 => 5.0292, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.59% (8.1363 => 8.2659, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.2842 => 1.3038, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.52% (0.7835 => 0.7954, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.47% (1.5415 => 1.5641, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (4.2646 => 4.3231, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (5.0018 => 5.0688, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.26% (3.3354 => 3.3774, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.22% (1.5603 => 1.5794, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8272, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0665 => 2.0878, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1861 => 1.1983, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.52% (26.0924 => 26.7493, std. dev.: 0.0294) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.28% (11.6436 => 11.7926, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.45% (0.8651 => 0.7314, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (5.2763 => 4.7989, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (2.9384 => 2.7017, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (1.1194 => 1.0507, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3318, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.43% (6.6874 => 6.3914, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: -2.93% (22.1758 => 21.5254, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.12% (5.3855 => 5.3254, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0929, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.77% (32.5116 => 31.6095, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3451, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 21:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 25 Jun 2012 23:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626041120.300B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1506?compare_to=1501&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1506, Order: 159179, Start Time: 2012-06-26 01:57:24, End Time: 2012-06-26 04:12:53 To: 1501, Order: 159171, Start Time: 2012-06-25 23:14:06, End Time: 2012-06-26 01:29:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.97% (0.3792 => 0.4663, std. dev.: 0.0192) SingleSource/UnitTests/ObjC/exceptions-3: 7.83% (0.3460 => 0.3731, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3465 => 0.3732, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.68% (0.3488 => 0.3756, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.67% (0.3442 => 0.3706, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3446 => 0.3710, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 7.58% (0.3469 => 0.3732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3496 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.22% (0.3643 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.3724 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.55% (0.5826 => 0.6033, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 3.46% (0.5889 => 0.6093, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (0.5026 => 0.5176, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.93% (0.5900 => 0.6073, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (1.6211 => 1.6618, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (3.5627 => 3.6431, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (1.3152 => 1.3423, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (0.4994 => 0.5095, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 1.98% (0.7171 => 0.7313, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.79% (4.2109 => 4.2861, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (2.0673 => 2.1034, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 1.59% (0.9909 => 1.0067, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (1.9694 => 1.9907, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.08% (1.0781 => 1.0897, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (2.7292 => 2.7583, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.02% (23.5202 => 23.7599, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (1.9966 => 2.0167, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.65% (2.8036 => 2.8498, std. dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.94% (11.9555 => 11.6045, std. dev.: 0.0033) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 22:42:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 00:42:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626054209.8028A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1507?compare_to=1504&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1507, Order: 159184, Start Time: 2012-06-26 04:47:00, End Time: 2012-06-26 05:43:41 To: 1504, Order: 159179, Start Time: 2012-06-26 02:18:56, End Time: 2012-06-26 03:15:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (108 on baseline) Performance Improvements: 5 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 885 (743 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.02% (25.8052 => 26.0676, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.27% (12.0854 => 12.4800, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5094 => 1.5369, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 1.04% (3.2518 => 3.2857, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.75% (6.3024 => 6.1921, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -1.51% (1.2729 => 1.2537, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2384 => 1.1105, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.94% (19.9811 => 18.5953, std. dev.: 0.0265) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1281 => 7.8942, std. dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2784, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 5.69% (0.5818 => 0.6149, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.53% (0.5748 => 0.6066, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7061 => 0.7412, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.74% (0.4328 => 0.4533, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7038 => 0.7359, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.40% (1.3693 => 1.4296, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2596 => 0.2709, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.26% (3.9660 => 4.1348, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.7710 => 0.8038, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.14% (0.4062 => 0.4230, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.2781 => 0.2894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.03% (0.2607 => 0.2712, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.5265 => 0.5476, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.94% (0.2690 => 0.2796, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.94% (0.3022 => 0.3141, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.2937 => 0.3049, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.3580 => 0.3713, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.64% (1.9828 => 2.0550, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.58% (0.3489 => 0.3614, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3149 => 0.3257, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3485 => 0.3604, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3107 => 0.3212, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2791, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4016 => 0.4147, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.3756 => 0.3877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.21% (0.3453 => 0.3564, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3601 => 0.3715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.10% (0.3646 => 0.3759, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 3.09% (0.3789 => 0.3906, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.00% (0.3534 => 0.3640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.99% (0.3914 => 0.4031, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 2.93% (0.3623 => 0.3729, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.92% (0.3868 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.92% (0.3663 => 0.3770, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.87% (0.3940 => 0.4053, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.4563 => 1.4975, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.62% (0.4390 => 0.4505, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1364 => 1.1655, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.3245 => 1.3569, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.42% (0.7506 => 0.7688, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0064, std. dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (3.8646 => 3.9548, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.31% (1.3813 => 1.4132, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.18% (1.9270 => 1.9691, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4096, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.00% (4.9865 => 5.0863, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2292 => 1.2537, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.90% (7.2180 => 7.3552, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7386, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8310 => 0.8464, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.2842 => 13.5263, std. dev.: 0.0109) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2158, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0863, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.5754 => 6.6681, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (0.8698 => 0.8818, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.3801 => 4.4375, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (4.4433 => 4.4961, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0404) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3932, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7325, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9694, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6778, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (4.1080 => 4.1983, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5089 => 1.5369, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7035, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8669, std. dev.: 0.0349) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8676, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.36% (0.3511 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.38% (6.2785 => 6.1921, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.58% (20.3410 => 18.5953, std. dev.: 0.0265) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.59% (2.6470 => 2.5519, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.26% (9.3358 => 9.1246, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2027, std. dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.5254 => 2.4861, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9797, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.46% (6.3560 => 6.2630, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2380, std. dev.: 0.0351) MultiSource/Benchmarks/mafft/pairlocalalign: -1.03% (28.2225 => 27.9316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jun 25 22:46:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 00:46:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626054631.DD9302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1508?compare_to=1505&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1508, Order: 159184, Start Time: 2012-06-26 04:47:17, End Time: 2012-06-26 05:48:04 To: 1505, Order: 159179, Start Time: 2012-06-26 02:54:25, End Time: 2012-06-26 03:55:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 4 (31 on baseline) Performance Improvements: 7 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 862 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.33% (12.0929 => 12.4958, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5102 => 1.5378, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.3024 => 2.3302, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.20% (3.2523 => 3.2913, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.89% (11.4866 => 11.0402, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (5.3499 => 5.2600, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (8.2165 => 8.0801, std. dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.25% (7.2971 => 7.2056, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.31% (1.2293 => 1.1148, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9412 => 18.5553, std. dev.: 0.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1422 => 7.9153, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.98% (0.3473 => 0.3750, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.74% (0.3516 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3543 => 0.3816, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3543 => 0.3815, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3694 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.21% (0.3886 => 0.4166, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.13% (0.3927 => 0.4207, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3828 => 0.4100, std. dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 6.49% (10.3673 => 11.0402, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (10.4361 => 10.9052, std. dev.: 0.0169) SingleSource/UnitTests/ObjC++/Hello: 3.85% (0.5925 => 0.6153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.73% (0.6030 => 0.6255, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.61% (21.9371 => 22.7293, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7326 => 0.7536, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4615 => 0.4732, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (7.0540 => 7.2056, std. dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (2.2022 => 2.2367, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0801, std. dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0116, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (8.1363 => 8.2457, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3217, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (9.4845 => 9.6098, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (5.0018 => 5.0619, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0873, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.87% (26.0924 => 26.8419, std. dev.: 0.0151) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5378, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.13% (0.8651 => 0.7256, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.19% (5.2763 => 4.7913, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.21% (2.9384 => 2.6972, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (1.1194 => 1.0490, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3190, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.05% (6.6874 => 6.4164, std. dev.: 0.0239) MultiSource/Applications/ClamAV/clamscan: -3.23% (22.1758 => 21.4606, std. dev.: 0.0315) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.73% (5.3526 => 5.2600, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (5.3855 => 5.2927, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2373 => 1.1148, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5553, std. dev.: 0.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9153, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6913, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 00:01:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 02:01:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626070146.B74ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1509?compare_to=1506&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1509, Order: 159184, Start Time: 2012-06-26 04:46:58, End Time: 2012-06-26 07:03:20 To: 1506, Order: 159179, Start Time: 2012-06-26 01:57:24, End Time: 2012-06-26 04:12:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.52% (0.3446 => 0.3705, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.49% (0.3460 => 0.3719, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.47% (0.3465 => 0.3724, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3442 => 0.3697, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.38% (0.3469 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.34% (0.3488 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.29% (0.3496 => 0.3751, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.12% (0.3650 => 0.3910, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3643 => 0.3898, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.3724 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.55% (0.5826 => 0.6033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.21% (0.5889 => 0.6078, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (0.5026 => 0.5162, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.69% (0.7171 => 0.7364, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (1.6211 => 1.6626, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (3.5627 => 3.6452, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 1.89% (4.2109 => 4.2904, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (1.3152 => 1.3400, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.30% (0.9909 => 1.0038, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (2.7292 => 2.7646, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (2.0673 => 2.0915, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (1.9694 => 1.9920, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.02% (1.8794 => 1.8985, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.01% (11.9555 => 11.5961, std. dev.: 0.0150) SingleSource/UnitTests/Vector/constpool: -2.64% (2.4764 => 2.4111, std. dev.: 0.0077) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 00:08:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 02:08:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626070817.3E47C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1510?compare_to=1507&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1510, Order: 159185, Start Time: 2012-06-26 06:10:36, End Time: 2012-06-26 07:09:50 To: 1507, Order: 159184, Start Time: 2012-06-26 04:47:00, End Time: 2012-06-26 05:43:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (775 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2766, std. dev.: 0.0571) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5818 => 0.6156, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5748 => 0.6061, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.14% (0.7061 => 0.7424, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (0.4328 => 0.4540, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 4.58% (0.7038 => 0.7360, std. dev.: 0.0120) MultiSource/Applications/hbd/hbd: 4.39% (1.3693 => 1.4294, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.14% (0.2781 => 0.2896, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.13% (3.9660 => 4.1296, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash: 4.06% (0.4062 => 0.4227, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2782 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.99% (0.2607 => 0.2711, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.90% (0.2690 => 0.2795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.84% (0.2655 => 0.2757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.2937 => 0.3049, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2726 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2765 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.62% (0.2761 => 0.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3107 => 0.3214, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.39% (0.3485 => 0.3603, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3149 => 0.3255, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2794, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.3756 => 0.3878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.24% (0.3453 => 0.3565, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4016 => 0.4142, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 3.11% (0.3601 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.05% (0.4003 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.01% (0.3914 => 0.4032, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.00% (0.3534 => 0.3640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.00% (0.3868 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.90% (0.3650 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 2.87% (0.3623 => 0.3727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 2.79% (0.3940 => 0.4050, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.69% (0.7506 => 0.7708, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4390 => 0.4503, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.36% (1.1061 => 1.1322, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.34% (16.6129 => 17.0021, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.11% (1.9270 => 1.9676, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.00% (4.9865 => 5.0863, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.98% (1.2292 => 1.2535, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0972, std. dev.: 0.0131) MultiSource/Applications/siod/siod: 1.49% (2.1791 => 2.2116, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.44% (6.5754 => 6.6701, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (0.8698 => 0.8816, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.86% (1.8175 => 2.2694, std. dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 6.86% (1.2998 => 1.3890, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7343, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.36% (1.7688 => 1.8282, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (4.1080 => 4.1983, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1931, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6435, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973, std. dev.: 0.0235) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8740, std. dev.: 0.4485) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.41% (0.3511 => 0.3356, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.06% (20.3410 => 18.7024, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0975, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6105, std. dev.: 0.0669) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9792, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2583, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7868, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9277, std. dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 00:16:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 02:16:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626071655.E78962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1511?compare_to=1508&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1511, Order: 159185, Start Time: 2012-06-26 06:15:18, End Time: 2012-06-26 07:18:29 To: 1508, Order: 159184, Start Time: 2012-06-26 04:47:17, End Time: 2012-06-26 05:48:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3543 => 0.3837, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.92% (0.3473 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3497 => 0.3766, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3543 => 0.3815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3516 => 0.3784, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 7.61% (0.3561 => 0.3832, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3694 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.15% (0.3886 => 0.4164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.13% (0.3927 => 0.4207, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3828 => 0.4099, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 6.49% (10.3673 => 11.0405, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.6030 => 0.6262, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5925 => 0.6152, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.96% (0.7326 => 0.7543, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (7.0540 => 7.2237, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4615 => 0.4726, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.8172 => 0.8365, std. dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (7.9617 => 8.0974, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.51% (2.2022 => 2.2355, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.50% (8.1363 => 8.2580, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (9.4845 => 9.6169, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (4.2646 => 4.3207, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.9449 => 5.0055, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (5.0018 => 5.0615, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.04% (1.5415 => 1.5576, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.91% (26.0924 => 26.8513, std. dev.: 0.0432) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.31% (3.6395 => 3.6871, std. dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.09% (0.8651 => 0.7259, std. dev.: 0.0233) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7942, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.18% (2.9384 => 2.6981, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0477, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3151, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (6.6874 => 6.4208, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.81% (5.3526 => 5.2555, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.70% (5.3855 => 5.2941, std. dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1160, std. dev.: 0.0434) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5322, std. dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9198, std. dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6828, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 02:36:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 04:36:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626093643.73D702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1512?compare_to=1510&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1512, Order: 159188, Start Time: 2012-06-26 08:41:35, End Time: 2012-06-26 09:38:17 To: 1510, Order: 159185, Start Time: 2012-06-26 06:10:36, End Time: 2012-06-26 07:09:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.98% (3.7749 => 3.8496, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.15% (3.7300 => 3.6872, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.11% (2.0176 => 2.2822, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.5818 => 0.6209, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7061 => 0.7478, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.07% (0.4062 => 0.4268, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.07% (0.2781 => 0.2922, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.96% (0.2782 => 0.2920, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7038 => 0.7386, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.91% (1.3693 => 1.4365, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 4.79% (0.2628 => 0.2754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.49% (1.9828 => 2.0718, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.46% (3.9660 => 4.1429, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.7710 => 0.8052, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.5265 => 0.5493, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3489 => 0.3639, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3149 => 0.3284, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.25% (0.3578 => 0.3730, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3485 => 0.3627, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.07% (0.4003 => 0.4166, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 4.06% (0.3646 => 0.3794, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 3.97% (0.3601 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.96% (0.3914 => 0.4069, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.95% (0.2988 => 0.3106, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.93% (0.3789 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.93% (0.3663 => 0.3807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3293 => 0.3422, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 3.89% (0.3623 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.89% (0.3650 => 0.3792, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.76% (0.3940 => 0.4088, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.64% (13.8202 => 14.3233, std. dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4390 => 0.4544, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.90% (16.6129 => 17.0948, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (0.4379 => 0.4504, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.4563 => 1.4974, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.67% (1.3245 => 1.3598, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.66% (1.2193 => 1.2517, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2292 => 1.2617, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9654, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1145, std. dev.: 0.0147) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1337, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9739, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4137, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.7460 => 0.7630, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.18% (1.3819 => 1.4120, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3706, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.10% (3.6692 => 3.7463, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.94% (14.8535 => 15.1419, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2208, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5378, std. dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.8698 => 0.8863, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.68% (0.6135 => 0.6238, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (6.5754 => 6.6810, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.53% (4.3801 => 4.4473, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.4433 => 4.5103, std. dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 1.16% (1.2749 => 1.2897, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.12% (3.1889 => 3.2245, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.66% (2.0200 => 2.1949, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3988, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.27% (7.4271 => 7.7440, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (2.8606 => 2.9696, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4802, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (4.1080 => 4.1967, std. dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 2.03% (3.7731 => 3.8496, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (1.5089 => 1.5393, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6469 => 3.7158, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6424, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9375, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.30% (0.3511 => 0.3360, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2139, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.49% (1.2308 => 1.1140, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (20.3410 => 18.6197, std. dev.: 0.0266) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std. dev.: 0.0141) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5847, std. dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.43% (9.3358 => 9.1088, std. dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5012, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2516, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9819, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7874, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.15% (0.9692 => 0.9581, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9270, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2453, std. dev.: 0.0283) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 02:41:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 04:41:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626094101.DB9982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1513?compare_to=1511&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1513, Order: 159188, Start Time: 2012-06-26 08:41:40, End Time: 2012-06-26 09:42:36 To: 1511, Order: 159185, Start Time: 2012-06-26 06:15:18, End Time: 2012-06-26 07:18:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (11.0405 => 11.2170, std. dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.20% (10.3673 => 11.2170, std. dev.: 0.0089) SingleSource/UnitTests/ObjC/trivial-interface: 7.40% (0.3473 => 0.3730, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.26% (0.3497 => 0.3751, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3543 => 0.3799, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.14% (0.3543 => 0.3796, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3561 => 0.3810, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 6.85% (0.3694 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.67% (0.3927 => 0.4189, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.56% (0.3886 => 0.4141, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 6.56% (0.3828 => 0.4079, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.37% (10.4361 => 10.8921, std. dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.51% (0.7326 => 0.7583, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.43% (21.9371 => 22.6890, std. dev.: 0.0353) SingleSource/UnitTests/ObjC++/property-reference-object: 3.37% (0.6030 => 0.6233, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/Hello: 3.34% (0.5925 => 0.6123, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7433 => 0.7631, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (7.0540 => 7.2054, std. dev.: 0.0179) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.8172 => 0.8329, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.85% (0.5569 => 0.5672, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0806, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (4.2646 => 4.3235, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (2.2022 => 2.2307, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.1363 => 8.2406, std. dev.: 0.0145) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (9.4845 => 9.5981, std. dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.14% (4.9449 => 5.0011, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (5.0018 => 5.0525, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8323, std. dev.: 0.0415) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.40% (0.8651 => 0.7232, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.28% (5.2763 => 4.7864, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.33% (2.9384 => 2.6935, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.65% (1.1194 => 1.0450, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3397, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (6.6874 => 6.4206, std. dev.: 0.0216) MultiSource/Applications/ClamAV/clamscan: -3.23% (22.1758 => 21.4586, std. dev.: 0.0290) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.06% (5.3526 => 5.2424, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.98% (5.3855 => 5.2787, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.18% (1.2373 => 1.0990, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.05% (19.9488 => 18.5424, std. dev.: 0.0408) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9257, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6857, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 02:49:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 04:49:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626094907.F321C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1514?compare_to=1509&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1514, Order: 159185, Start Time: 2012-06-26 07:34:57, End Time: 2012-06-26 09:50:42 To: 1509, Order: 159184, Start Time: 2012-06-26 04:46:58, End Time: 2012-06-26 07:03:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (26 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3460 => 0.3721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3488 => 0.3750, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.47% (0.3465 => 0.3724, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3446 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3442 => 0.3697, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/synchronized: 7.35% (0.3469 => 0.3724, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.24% (0.3496 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3643 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3724 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5826 => 0.6026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.5889 => 0.6079, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (1.6211 => 1.6612, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.5900 => 0.6031, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (3.5627 => 3.6410, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (1.3152 => 1.3439, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (0.4994 => 0.5102, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.08% (0.7171 => 0.7320, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 1.99% (4.2109 => 4.2948, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (2.7292 => 2.7641, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (1.9694 => 1.9934, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 1.17% (0.9909 => 1.0025, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.14% (1.0781 => 1.0904, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (1.9966 => 2.0172, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.03% (23.5202 => 23.7619, std. dev.: 0.0279) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (2.1653 => 2.1873, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.96% (11.9555 => 11.6017, std. dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -2.82% (2.4764 => 2.4066, std. dev.: 0.0151) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 04:00:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 06:00:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626110011.A5DAD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1515?compare_to=1512&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1515, Order: 159191, Start Time: 2012-06-26 10:05:16, End Time: 2012-06-26 11:01:46 To: 1512, Order: 159188, Start Time: 2012-06-26 08:41:35, End Time: 2012-06-26 09:38:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (748 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (2.0718 => 2.0502, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.58% (2.0176 => 2.2915, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.76% (0.5818 => 0.6153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5748 => 0.6064, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7061 => 0.7409, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (0.4328 => 0.4535, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.58% (0.7038 => 0.7360, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.54% (1.3693 => 1.4315, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.38% (0.4062 => 0.4240, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.32% (3.9660 => 4.1375, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 4.31% (0.2781 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.20% (0.2596 => 0.2705, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.97% (0.5265 => 0.5474, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.90% (0.3022 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.7710 => 0.8008, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2726 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2765 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.60% (0.3107 => 0.3219, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.2937 => 0.3041, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.2966 => 0.3070, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3006, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.3899 => 0.4034, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.45% (0.3192 => 0.3302, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.44% (0.3489 => 0.3609, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.40% (1.9828 => 2.0502, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (0.3485 => 0.3602, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3453 => 0.3568, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3580 => 0.3698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.29% (0.4016 => 0.4148, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9199 => 0.9489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.97% (0.3534 => 0.3639, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3756 => 0.3865, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.4390 => 0.4516, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.3868 => 0.3979, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 2.77% (0.3789 => 0.3894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.67% (0.4003 => 0.4110, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.4563 => 1.4952, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 2.61% (0.3914 => 0.4016, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3245 => 1.3584, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 2.54% (0.3940 => 0.4040, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4379 => 0.4489, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5577 => 0.5717, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.48% (16.6129 => 17.0257, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (3.8646 => 3.9538, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 2.24% (1.9270 => 1.9702, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.19% (4.9865 => 5.0956, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.19% (1.1061 => 1.1303, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (1.3819 => 1.4109, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.07% (1.2292 => 1.2547, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8310 => 0.8477, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (3.6692 => 3.7388, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (7.2180 => 7.3502, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (13.2842 => 13.5226, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 1.70% (14.8535 => 15.1064, std. dev.: 0.0059) MultiSource/Applications/siod/siod: 1.70% (2.1791 => 2.2162, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.50% (6.5754 => 6.6743, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.8698 => 0.8823, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.3801 => 4.4357, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (4.4433 => 4.4948, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.04% (3.1889 => 3.2220, std. dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0430) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.38% (1.2998 => 1.3827, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7167, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1980, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7082, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9595, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6453, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.30% (0.4657 => 0.3758, std. dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9268, std. dev.: 0.0255) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.10% (0.3511 => 0.3367, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.6576 => 0.6463, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.67% (6.2785 => 6.1739, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1074, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.09% (20.3410 => 18.4925, std. dev.: 0.1263) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5886, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -2.54% (9.3358 => 9.0985, std. dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2488, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9794, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2242, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4907, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (9.9194 => 9.7880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8462, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2327, std. dev.: 0.0193) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9269, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 04:08:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 06:08:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626110849.F225C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1516?compare_to=1513&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1516, Order: 159191, Start Time: 2012-06-26 10:09:41, End Time: 2012-06-26 11:10:25 To: 1513, Order: 159188, Start Time: 2012-06-26 08:41:40, End Time: 2012-06-26 09:42:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (24 on baseline) Performance Improvements: 1 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.60% (1.0990 => 1.1166, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.67% (0.7583 => 0.7456, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.40% (10.3673 => 11.1348, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3473 => 0.3695, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.18% (0.3543 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.03% (0.3516 => 0.3728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3543 => 0.3756, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3561 => 0.3775, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.82% (0.3694 => 0.3909, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.68% (0.3927 => 0.4150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3828 => 0.4045, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.56% (0.3886 => 0.4102, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.55% (10.4361 => 10.9107, std. dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 3.23% (21.9371 => 22.6464, std. dev.: 0.0180) SingleSource/UnitTests/ObjC++/Hello: 2.67% (0.5925 => 0.6083, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 2.59% (0.6030 => 0.6186, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7433 => 0.7607, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.22% (7.0540 => 7.2104, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7326 => 0.7456, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (7.9617 => 8.0660, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.9449 => 5.0004, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.09% (2.2022 => 2.2261, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7839, std. dev.: 0.0224) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.84% (0.8651 => 0.7281, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.10% (5.2763 => 4.7963, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.15% (2.9384 => 2.6988, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.34% (1.1194 => 1.0484, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3445, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.04% (6.6874 => 6.4175, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -3.24% (22.1758 => 21.4576, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.74% (5.3526 => 5.2593, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.60% (5.3855 => 5.2996, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.07% (1.7609 => 1.7421, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5725, std. dev.: 0.0430) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9191, std. dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6789, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 05:23:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 07:23:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626122329.3C6AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1517?compare_to=1515&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1517, Order: 159197, Start Time: 2012-06-26 11:28:36, End Time: 2012-06-26 12:25:03 To: 1515, Order: 159191, Start Time: 2012-06-26 10:05:16, End Time: 2012-06-26 11:01:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (751 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.27% (7.9347 => 8.0357, std. dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.52% (2.0176 => 2.2904, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.5818 => 0.6146, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.34% (0.5748 => 0.6055, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.84% (0.7061 => 0.7403, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.72% (0.7038 => 0.7370, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.54% (1.3693 => 1.4314, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.21% (3.9660 => 4.1328, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 4.14% (0.4062 => 0.4230, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.12% (0.2596 => 0.2703, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.7710 => 0.8013, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2781 => 0.2890, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.5265 => 0.5469, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.71% (0.3022 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2726 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2782 => 0.2885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.58% (0.2937 => 0.3042, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3107 => 0.3218, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.2966 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3489 => 0.3607, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.35% (13.8202 => 14.2835, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.3899 => 0.4028, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.9828 => 2.0478, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3453 => 0.3566, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3192 => 0.3295, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.21% (0.3485 => 0.3597, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3580 => 0.3695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4016 => 0.4143, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 2.84% (0.3868 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 2.79% (0.3578 => 0.3678, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (0.3756 => 0.3860, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4390 => 0.4510, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0594 => 1.0882, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 2.70% (0.4003 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 2.69% (0.3789 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.66% (0.3914 => 0.4018, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4379 => 0.4495, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.61% (1.3245 => 1.3591, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.4563 => 1.4938, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1364 => 1.1655, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.31% (16.6129 => 16.9965, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 2.16% (0.7506 => 0.7668, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.15% (4.9865 => 5.0935, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (3.8646 => 3.9471, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.09% (1.9270 => 1.9672, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (1.3819 => 1.4098, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2292 => 1.2538, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8310 => 0.8474, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (7.2180 => 7.3491, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (3.6692 => 3.7355, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5161, std. dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 1.67% (14.8535 => 15.1014, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 1.58% (2.1791 => 2.2135, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6720, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.18% (4.3801 => 4.4316, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (4.4433 => 4.4933, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 1.05% (3.1889 => 3.2225, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2658, std. dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1895, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.79% (1.2998 => 1.3881, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7350, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.18% (4.1080 => 4.1974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6443, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8558, std. dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9203, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.69% (6.2785 => 6.1722, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1068, std. dev.: 0.0178) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5273, std. dev.: 0.0930) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0115) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6006, std. dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.45% (9.3358 => 9.1067, std. dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2600, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2224, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7875, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2356, std. dev.: 0.0706) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9291, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 05:31:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 07:31:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626123125.921872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1518?compare_to=1514&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1518, Order: 159191, Start Time: 2012-06-26 10:17:37, End Time: 2012-06-26 12:33:00 To: 1514, Order: 159185, Start Time: 2012-06-26 07:34:57, End Time: 2012-06-26 09:50:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (24 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3465 => 0.3717, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 7.20% (0.3446 => 0.3694, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3460 => 0.3707, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.03% (0.3442 => 0.3684, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.02% (0.3488 => 0.3733, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/synchronized: 7.00% (0.3469 => 0.3712, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.86% (0.3496 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.70% (0.3643 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.63% (0.3650 => 0.3892, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.3724 => 0.3965, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5826 => 0.6032, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.5889 => 0.6089, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (1.6211 => 1.6598, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.35% (0.5026 => 0.5144, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 2.08% (0.7171 => 0.7320, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (3.5627 => 3.6355, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.58% (4.2109 => 4.2775, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (1.3152 => 1.3353, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.49% (2.0673 => 2.0981, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.31% (0.9909 => 1.0039, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.09% (1.0781 => 1.0899, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.07% (1.9694 => 1.9905, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (1.9966 => 2.0167, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.83% (11.9555 => 11.6169, std. dev.: 0.0153) Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 05:36:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 07:36:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626123641.BF0302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1519?compare_to=1516&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1519, Order: 159197, Start Time: 2012-06-26 11:37:28, End Time: 2012-06-26 12:38:16 To: 1516, Order: 159191, Start Time: 2012-06-26 10:09:41, End Time: 2012-06-26 11:10:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 7.44% (10.3673 => 11.1386, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 6.31% (0.3473 => 0.3692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.24% (0.3543 => 0.3764, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 6.14% (0.3516 => 0.3732, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3543 => 0.3755, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.74% (0.3694 => 0.3906, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3828 => 0.4043, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.58% (0.3927 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.51% (0.3886 => 0.4100, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9205, std. dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 3.24% (21.9371 => 22.6468, std. dev.: 0.0291) SingleSource/UnitTests/ObjC++/Hello: 2.65% (0.5925 => 0.6082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.57% (0.6030 => 0.6185, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4615 => 0.4732, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.48% (0.7433 => 0.7617, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.8172 => 0.8350, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.11% (7.0540 => 7.2030, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 1.68% (0.7326 => 0.7449, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.14% (2.2022 => 2.2273, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (7.9617 => 8.0488, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (8.1363 => 8.2227, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (5.0018 => 5.0523, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.75% (26.0924 => 26.8089, std. dev.: 0.0420) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6395 => 3.6776, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.82% (0.8651 => 0.7282, std. dev.: 0.0302) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (5.2763 => 4.7967, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (2.9384 => 2.6978, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (1.1194 => 1.0502, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3430, std. dev.: 0.0400) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.01% (6.6874 => 6.4192, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: -3.39% (22.1758 => 21.4234, std. dev.: 0.0325) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.70% (5.3526 => 5.2615, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.55% (5.3855 => 5.3022, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.06% (1.7609 => 1.7422, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5987, std. dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.80% (8.1563 => 7.9280, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6847, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 06:46:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 08:46:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626134648.5E9FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1520?compare_to=1517&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1520, Order: 159201, Start Time: 2012-06-26 12:51:51, End Time: 2012-06-26 13:48:23 To: 1517, Order: 159197, Start Time: 2012-06-26 11:28:36, End Time: 2012-06-26 12:25:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.3881 => 1.4073, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.11% (2.0176 => 2.2821, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5818 => 0.6162, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5748 => 0.6074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7061 => 0.7423, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4328 => 0.4542, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.75% (1.3693 => 1.4344, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7038 => 0.7359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 4.31% (0.2781 => 0.2901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2596 => 0.2706, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (3.9660 => 4.1334, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.10% (0.3022 => 0.3146, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2782 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2726 => 0.2835, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.96% (0.7710 => 0.8015, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.95% (0.2655 => 0.2760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2607 => 0.2709, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.85% (0.2937 => 0.3050, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.84% (0.2966 => 0.3080, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2765 => 0.2871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.83% (0.2690 => 0.2793, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.81% (0.3149 => 0.3269, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.5265 => 0.5465, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3489 => 0.3620, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.9828 => 2.0561, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2760 => 0.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.63% (0.3192 => 0.3308, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3485 => 0.3609, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3899 => 0.4037, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3293 => 0.3408, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.4016 => 0.4156, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3580 => 0.3704, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.31% (13.8202 => 14.2776, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (0.3756 => 0.3874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.14% (0.3534 => 0.3645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.92% (0.4390 => 0.4518, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 2.85% (0.3578 => 0.3680, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 2.82% (0.3789 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.78% (0.3914 => 0.4023, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 2.75% (0.4003 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.74% (0.3646 => 0.3746, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 2.59% (0.3940 => 0.4042, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.4563 => 1.4932, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4379 => 0.4487, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.3245 => 1.3565, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.9865 => 5.1066, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.35% (0.5577 => 0.5708, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.32% (16.6129 => 16.9991, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.22% (0.7506 => 0.7673, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2292 => 1.2562, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9489, std. dev.: 0.0106) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.09% (1.9270 => 1.9673, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5410, std. dev.: 0.0191) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.91% (1.3819 => 1.4083, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7385, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (7.2180 => 7.3533, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8310 => 0.8465, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.66% (14.8535 => 15.0997, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8698 => 0.8838, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.59% (2.1791 => 2.2138, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6718, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.28% (4.3801 => 4.4361, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (4.4433 => 4.4959, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.02% (3.1889 => 3.2215, std. dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.18% (1.8175 => 2.2752, std. dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.27% (1.2998 => 1.4073, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7184, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (2.8606 => 2.9695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (4.1080 => 4.1968, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6469 => 3.7161, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9534, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.6975 => 3.7356, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6401, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.55% (0.4657 => 0.3793, std. dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.32% (22.5627 => 20.9113, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.8818 => 0.8534, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (6.2785 => 6.1769, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (20.3410 => 18.6251, std. dev.: 0.0369) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.45% (1.3780 => 1.3029, std. dev.: 0.0113) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5956, std. dev.: 0.0136) MultiSource/Applications/minisat/minisat: -2.59% (9.3358 => 9.0944, std. dev.: 0.0261) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2471, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2230, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9829, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7871, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2226, std. dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9276, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 07:04:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 09:04:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626140421.9B0332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1521?compare_to=1519&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1521, Order: 159201, Start Time: 2012-06-26 13:05:18, End Time: 2012-06-26 14:05:56 To: 1519, Order: 159197, Start Time: 2012-06-26 11:37:28, End Time: 2012-06-26 12:38:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (24 on baseline) Performance Improvements: 1 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (834 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (11.1386 => 10.8819, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.46% (0.3543 => 0.3772, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 6.02% (0.3473 => 0.3682, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3497 => 0.3704, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.89% (0.3516 => 0.3723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.79% (0.3543 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.78% (0.3561 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.58% (0.3694 => 0.3900, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 5.35% (0.3886 => 0.4094, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.33% (0.3828 => 0.4032, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.32% (0.3927 => 0.4136, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.96% (10.3673 => 10.8819, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (10.4361 => 10.8337, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 3.18% (21.9371 => 22.6353, std. dev.: 0.0112) SingleSource/UnitTests/ObjC++/property-reference-object: 2.60% (0.6030 => 0.6187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.53% (0.5925 => 0.6075, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.41% (0.7433 => 0.7612, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.8172 => 0.8334, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (7.0540 => 7.1893, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 1.76% (0.7326 => 0.7455, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8190, std. dev.: 0.0237) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6395 => 3.6799, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.81% (0.8651 => 0.7283, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.33% (5.2763 => 4.7841, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.49% (2.9384 => 2.6888, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.39% (1.1194 => 1.0479, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3367, std. dev.: 0.0407) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.08% (6.6874 => 6.4144, std. dev.: 0.0391) MultiSource/Applications/ClamAV/clamscan: -3.41% (22.1758 => 21.4193, std. dev.: 0.0184) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.81% (5.3526 => 5.2556, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (5.3855 => 5.2918, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.49% (1.7609 => 1.7347, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.78% (1.2373 => 1.1039, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.45% (19.9488 => 18.6628, std. dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (8.1563 => 7.9305, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6823, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 08:12:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 10:12:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626151214.514E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1522?compare_to=1520&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1522, Order: 159202, Start Time: 2012-06-26 14:17:18, End Time: 2012-06-26 15:13:49 To: 1520, Order: 159201, Start Time: 2012-06-26 12:51:51, End Time: 2012-06-26 13:48:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (91 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (760 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7435 => 3.6969, std. dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2778, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.48% (0.5818 => 0.6137, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.34% (0.5748 => 0.6055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7061 => 0.7404, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.51% (0.4328 => 0.4523, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.29% (1.3693 => 1.4280, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7038 => 0.7339, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.7710 => 0.8019, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (3.9660 => 4.1220, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.89% (0.2596 => 0.2697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.4062 => 0.4218, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5265 => 0.5460, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2765 => 0.2867, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.2781 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.59% (0.2782 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3022 => 0.3128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3453 => 0.3568, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.28% (0.6959 => 0.7187, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (1.9828 => 2.0470, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3107 => 0.3207, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4016 => 0.4145, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.18% (0.3489 => 0.3600, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.09% (13.8202 => 14.2479, std. dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.04% (0.3485 => 0.3591, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 2.88% (0.3578 => 0.3681, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 2.80% (0.3601 => 0.3702, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.3868 => 0.3976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 2.74% (0.3789 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 2.73% (0.3663 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.72% (0.4003 => 0.4112, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.67% (1.0594 => 1.0877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.66% (0.3914 => 0.4018, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4916, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2469, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.15% (16.6129 => 16.9705, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3528, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.02% (4.9865 => 5.0873, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.97% (0.7506 => 0.7654, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9406, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.93% (1.9270 => 1.9642, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.88% (1.1061 => 1.1269, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8310 => 0.8463, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4064, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.2292 => 1.2513, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (13.2842 => 13.5107, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7309, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.65% (7.2180 => 7.3372, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0760, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (6.5754 => 6.6628, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 1.27% (2.1791 => 2.2068, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.21% (0.8698 => 0.8803, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.10% (4.3801 => 4.4282, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.22% (1.8175 => 2.2941, std. dev.: 0.0397) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7304, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9699, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (4.1080 => 4.1985, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7073, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1921, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9515, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.33% (0.4657 => 0.3850, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8830, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.76% (6.2785 => 6.1679, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.41% (33.2944 => 32.8265, std. dev.: 0.0187) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7044, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2308 => 1.1108, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.00% (20.3410 => 18.5099, std. dev.: 0.0669) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5919, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: -2.49% (9.3358 => 9.1029, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9788, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2175, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7879, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0151) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2255, std. dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9298, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 08:13:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 10:13:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626151344.DC9202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1523?compare_to=1518&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1523, Order: 159201, Start Time: 2012-06-26 12:59:53, End Time: 2012-06-26 15:15:19 To: 1518, Order: 159191, Start Time: 2012-06-26 10:17:37, End Time: 2012-06-26 12:33:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (26 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 19.37% (0.3831 => 0.4573, std. dev.: 0.0173) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.60% (0.3792 => 0.4573, std. dev.: 0.0173) SingleSource/UnitTests/ObjC/exceptions-4: 7.36% (0.3465 => 0.3720, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.34% (0.3446 => 0.3699, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3469 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.08% (0.3488 => 0.3735, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3460 => 0.3705, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.03% (0.3442 => 0.3684, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.01% (0.3496 => 0.3741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.70% (0.3643 => 0.3887, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.68% (0.3650 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.3724 => 0.3968, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.59% (0.5826 => 0.6035, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 3.48% (0.5889 => 0.6094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7171 => 0.7372, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (1.6211 => 1.6631, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (0.5026 => 0.5147, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3454, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (3.5627 => 3.6387, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: 1.72% (4.2109 => 4.2832, std. dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 1.57% (0.9909 => 1.0065, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.53% (2.0673 => 2.0989, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (1.9694 => 1.9976, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.22% (1.0781 => 1.0912, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.04% (1.9966 => 2.0173, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 1.03% (1.8794 => 1.8987, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.70% (11.9555 => 11.6329, std. dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: -2.35% (2.4764 => 2.4182, std. dev.: 0.0030) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 08:32:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 10:32:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626153207.399452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1524?compare_to=1521&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1524, Order: 159203, Start Time: 2012-06-26 14:33:00, End Time: 2012-06-26 15:33:40 To: 1521, Order: 159201, Start Time: 2012-06-26 13:05:18, End Time: 2012-06-26 14:05:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (27 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (10.8819 => 11.0587, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (10.3673 => 11.0587, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 6.05% (0.3473 => 0.3683, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.81% (0.3561 => 0.3768, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 5.80% (0.3516 => 0.3720, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.79% (0.3543 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3694 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.32% (0.3927 => 0.4136, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.30% (0.3828 => 0.4031, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (10.4361 => 10.8324, std. dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 3.04% (21.9371 => 22.6043, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/Hello: 2.68% (0.5925 => 0.6084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.67% (0.6030 => 0.6191, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4615 => 0.4729, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (7.0540 => 7.2131, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.21% (0.7433 => 0.7597, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.72% (0.7326 => 0.7452, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (2.2022 => 2.2315, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (9.4845 => 9.5884, std. dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (7.9617 => 8.0450, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.1363 => 8.2213, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.7996, std. dev.: 0.0260) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5355, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4476, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6395 => 3.6811, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.82% (0.8651 => 0.7282, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.06% (5.2763 => 4.7981, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.25% (2.9384 => 2.6960, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.43% (1.1194 => 1.0474, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.3994, std. dev.: 0.0221) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.08% (6.6874 => 6.4147, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: -3.44% (22.1758 => 21.4120, std. dev.: 0.0262) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.51% (5.3526 => 5.2719, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.35% (5.3855 => 5.3128, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5882, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9208, std. dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6888, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 09:35:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 11:35:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626163534.717DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1525?compare_to=1522&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1525, Order: 159203, Start Time: 2012-06-26 15:40:37, End Time: 2012-06-26 16:37:09 To: 1522, Order: 159202, Start Time: 2012-06-26 14:17:18, End Time: 2012-06-26 15:13:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (751 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.34% (2.2941 => 2.2634, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2722, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.43% (0.5818 => 0.6134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.36% (0.5748 => 0.6056, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.25% (0.7061 => 0.7432, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4328 => 0.4539, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (0.7038 => 0.7366, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 4.45% (1.3693 => 1.4302, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.23% (0.4062 => 0.4234, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (3.9660 => 4.1286, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.07% (0.3022 => 0.3145, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.04% (0.2596 => 0.2701, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2726 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.7710 => 0.8009, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.5265 => 0.5469, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.3899 => 0.4049, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.78% (0.2966 => 0.3078, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3107 => 0.3218, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.52% (0.3580 => 0.3706, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3489 => 0.3610, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.45% (0.3192 => 0.3302, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.40% (0.2937 => 0.3037, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (1.9828 => 2.0500, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.24% (0.3453 => 0.3565, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.24% (0.3485 => 0.3598, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4016 => 0.4144, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.16% (13.8202 => 14.2571, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (0.3756 => 0.3867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.83% (0.3534 => 0.3634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.82% (0.3868 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 2.75% (0.4003 => 0.4113, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.0594 => 1.0885, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4390 => 0.4510, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 2.63% (0.3914 => 0.4017, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.4563 => 1.4938, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.3245 => 1.3580, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.45% (16.6129 => 17.0191, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5577 => 0.5710, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.26% (1.1061 => 1.1311, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (3.8646 => 3.9510, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.20% (4.9865 => 5.0962, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (1.3819 => 1.4118, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.10% (1.9270 => 1.9675, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4100, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8310 => 0.8477, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2292 => 1.2538, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7385, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (7.2180 => 7.3530, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5230, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2157, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.68% (14.8535 => 15.1024, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.8698 => 0.8829, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (6.5754 => 6.6697, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (4.3801 => 4.4384, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (4.4433 => 4.4987, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.02% (3.1889 => 3.2213, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7255, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9699, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.22% (4.1080 => 4.1993, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7075, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5089 => 1.5326, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6434, std. dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9475, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.41% (0.3511 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.04% (0.6576 => 0.6442, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.55% (6.2785 => 6.1814, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.54% (0.9108 => 0.8968, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.02% (33.2944 => 32.9543, std. dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.57% (1.2308 => 1.1130, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (20.3410 => 18.6338, std. dev.: 0.0215) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3042, std. dev.: 0.0124) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0157) MultiSource/Applications/minisat/minisat: -2.61% (9.3358 => 9.0919, std. dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4965, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2476, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.5254 => 2.4866, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9800, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2190, std. dev.: 0.0268) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7878, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9282, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 10:38:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 12:38:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626173847.875342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1526?compare_to=1524&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1526, Order: 159206, Start Time: 2012-06-26 16:39:44, End Time: 2012-06-26 17:40:21 To: 1524, Order: 159203, Start Time: 2012-06-26 14:33:00, End Time: 2012-06-26 15:33:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (26 on baseline) Performance Improvements: 0 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.98% (11.0587 => 11.2782, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.79% (10.3673 => 11.2782, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3473 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3497 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.67% (0.3543 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3543 => 0.3742, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.62% (0.3561 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3516 => 0.3713, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.47% (0.3694 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.28% (0.3828 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.25% (0.3927 => 0.4133, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 5.20% (0.3886 => 0.4088, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (10.4361 => 10.8154, std. dev.: 0.0169) MultiSource/Applications/JM/lencod/lencod: 3.01% (21.9371 => 22.5985, std. dev.: 0.0303) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.63% (7.0540 => 7.2398, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/Hello: 2.46% (0.5925 => 0.6071, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.45% (0.7433 => 0.7615, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 2.34% (0.6030 => 0.6171, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.8172 => 0.8303, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7326 => 0.7437, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (2.2022 => 2.2311, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (7.9617 => 8.0522, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.2646 => 4.3112, std. dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.79% (26.0924 => 26.8206, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6395 => 3.6801, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.85% (0.8651 => 0.7280, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.36% (5.2763 => 4.7825, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.51% (2.9384 => 2.6884, std. dev.: 0.0260) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.66% (1.1194 => 1.0448, std. dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3347, std. dev.: 0.0279) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.16% (6.6874 => 6.4093, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -3.30% (22.1758 => 21.4432, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.50% (5.3526 => 5.2721, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.40% (5.3855 => 5.3102, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (1.7609 => 1.7411, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1113, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.59% (19.9488 => 18.6332, std. dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9212, std. dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6940, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 10:56:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 12:56:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626175612.5C9FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1527?compare_to=1523&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1527, Order: 159203, Start Time: 2012-06-26 15:42:09, End Time: 2012-06-26 17:57:43 To: 1523, Order: 159201, Start Time: 2012-06-26 12:59:53, End Time: 2012-06-26 15:15:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (21 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 893 (872 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (2.0685 => 2.0933, std. dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.96% (0.3446 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.87% (0.3465 => 0.3703, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3488 => 0.3727, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3469 => 0.3706, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3460 => 0.3696, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 6.80% (0.3442 => 0.3676, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.72% (0.3496 => 0.3731, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.48% (0.3643 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.44% (0.3650 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.31% (0.3724 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.12% (0.5826 => 0.6008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.94% (0.5889 => 0.6062, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (0.5026 => 0.5168, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (1.6211 => 1.6617, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 2.25% (0.7171 => 0.7332, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (3.5627 => 3.6348, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (0.5900 => 0.6007, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (1.3152 => 1.3381, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 1.66% (4.2109 => 4.2809, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.10% (1.0781 => 1.0900, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0673 => 2.0885, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -3.01% (11.9555 => 11.5961, std. dev.: 0.0071) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 10:58:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 12:58:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626175858.7D2E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1528?compare_to=1525&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1528, Order: 159207, Start Time: 2012-06-26 17:04:03, End Time: 2012-06-26 18:00:33 To: 1525, Order: 159203, Start Time: 2012-06-26 15:40:37, End Time: 2012-06-26 16:37:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (753 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2778, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.43% (0.5818 => 0.6134, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5748 => 0.6054, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (0.7038 => 0.7377, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7061 => 0.7397, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 4.69% (0.4328 => 0.4531, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 4.40% (1.3693 => 1.4295, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.11% (0.4062 => 0.4229, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2781 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.05% (3.9660 => 4.1265, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.04% (0.2596 => 0.2701, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.99% (0.7710 => 0.8018, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2726 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.78% (0.5265 => 0.5464, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.77% (0.3022 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2760 => 0.2863, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.64% (0.3899 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.61% (0.2966 => 0.3073, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.59% (0.2782 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3149 => 0.3262, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3489 => 0.3612, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.51% (0.3107 => 0.3216, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.44% (1.9828 => 2.0511, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.6959 => 0.7198, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.41% (0.3580 => 0.3702, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3192 => 0.3298, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3453 => 0.3566, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.27% (0.3485 => 0.3599, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2644, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4016 => 0.4142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (0.3756 => 0.3866, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 2.92% (0.3868 => 0.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 2.70% (0.4003 => 0.4111, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.64% (0.4390 => 0.4506, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.0594 => 1.0872, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.48% (1.4563 => 1.4924, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.3245 => 1.3569, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0172, std. dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.40% (0.4379 => 0.4484, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.27% (3.8646 => 3.9525, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.25% (4.9865 => 5.0989, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.25% (1.1061 => 1.1310, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9694, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.14% (0.7506 => 0.7667, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2292 => 1.2538, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 1.91% (0.8310 => 0.8469, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (1.3819 => 1.4079, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.84% (7.2180 => 7.3506, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (3.6692 => 3.7356, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5231, std. dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1077, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.66% (2.1791 => 2.2153, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (6.5754 => 6.6761, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.47% (0.8698 => 0.8826, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.28% (4.3801 => 4.4362, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (4.4433 => 4.4957, std. dev.: 0.0081) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2238, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.65% (1.8175 => 2.3018, std. dev.: 0.0369) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7335, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.13% (4.1080 => 4.1954, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7055, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5319, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1931, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6416, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std. dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9366, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (6.2785 => 6.1880, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5242, std. dev.: 0.0819) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.56% (9.3358 => 9.0965, std. dev.: 0.0480) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6092, std. dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2536, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2203, std. dev.: 0.0094) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2147, std. dev.: 0.0348) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9272, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 12:06:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 14:06:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626190639.4B1EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1529?compare_to=1526&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1529, Order: 159210, Start Time: 2012-06-26 18:07:28, End Time: 2012-06-26 19:08:12 To: 1526, Order: 159206, Start Time: 2012-06-26 16:39:44, End Time: 2012-06-26 17:40:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 1 (15 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.8303 => 0.8436, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (11.2782 => 11.0787, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.86% (10.3673 => 11.0787, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 6.59% (0.3473 => 0.3702, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.44% (0.3543 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3543 => 0.3769, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.35% (0.3561 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.34% (0.3516 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.09% (0.3694 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.94% (0.3886 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.93% (0.3927 => 0.4160, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3828 => 0.4052, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.08% (10.4361 => 10.8618, std. dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 3.26% (21.9371 => 22.6532, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.23% (0.8172 => 0.8436, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.81% (0.7433 => 0.7642, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.55% (0.6030 => 0.6184, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.48% (0.5925 => 0.6072, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (7.0540 => 7.2190, std. dev.: 0.0280) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.23% (0.4615 => 0.4718, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 1.58% (0.7326 => 0.7442, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.48% (0.7835 => 0.7951, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (7.9617 => 8.0734, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (8.1363 => 8.2447, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (9.4845 => 9.5997, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.2646 => 4.3162, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.14% (2.2022 => 2.2274, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.13% (5.7591 => 5.8241, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7968, std. dev.: 0.0509) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5387, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6395 => 3.6766, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.78% (0.8651 => 0.7286, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.31% (5.2763 => 4.7849, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.33% (2.9384 => 2.6935, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.66% (1.1194 => 1.0449, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -4.88% (54.1659 => 51.5231, std. dev.: 0.0292) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.98% (6.6874 => 6.4210, std. dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: -3.17% (22.1758 => 21.4726, std. dev.: 0.0234) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.44% (5.3855 => 5.3077, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.40% (5.3526 => 5.2777, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (1.7609 => 1.7406, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.78% (1.2373 => 1.1039, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5558, std. dev.: 0.0691) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9209, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6920, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 12:22:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 14:22:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626192202.24E272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1530?compare_to=1528&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1530, Order: 159213, Start Time: 2012-06-26 18:27:29, End Time: 2012-06-26 19:23:36 To: 1528, Order: 159207, Start Time: 2012-06-26 17:04:03, End Time: 2012-06-26 18:00:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 4 (4 on baseline) Performance Regressions: 0 (109 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -29.11% (0.0869 => 0.0616, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.47% (0.5818 => 0.6136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5748 => 0.6061, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4328 => 0.4542, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7061 => 0.7406, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.59% (0.7038 => 0.7361, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.42% (1.3693 => 1.4298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2596 => 0.2706, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 4.19% (0.4062 => 0.4232, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.13% (0.2782 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2781 => 0.2895, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.09% (3.9660 => 4.1284, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.97% (0.3022 => 0.3142, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.94% (0.2690 => 0.2796, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 3.92% (0.2628 => 0.2731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.5265 => 0.5469, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.7710 => 0.8008, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.3899 => 0.4049, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2760 => 0.2864, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2966 => 0.3077, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2726 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (1.9828 => 2.0560, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/methcall: 3.66% (0.2761 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.3489 => 0.3615, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.54% (0.3107 => 0.3217, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3149 => 0.3259, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.6959 => 0.7194, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.35% (0.3580 => 0.3700, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3453 => 0.3566, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.27% (0.3485 => 0.3599, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3192 => 0.3296, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.17% (13.8202 => 14.2583, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4016 => 0.4143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.08% (0.3868 => 0.3987, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3293 => 0.3394, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.04% (0.3756 => 0.3870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.91% (0.3534 => 0.3637, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9199 => 0.9465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.82% (0.4003 => 0.4116, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.4390 => 0.4512, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 2.71% (0.3914 => 0.4020, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.67% (1.0594 => 1.0877, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.4563 => 1.4949, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 2.54% (0.3940 => 0.4040, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4379 => 0.4488, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.3245 => 1.3569, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.40% (16.6129 => 17.0116, std. dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 2.27% (3.8646 => 3.9522, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4120, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1306, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.20% (0.7506 => 0.7671, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.19% (1.3819 => 1.4122, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (4.9865 => 5.0922, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2292 => 1.2550, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.08% (1.9270 => 1.9671, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8310 => 0.8470, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (3.6692 => 3.7367, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.79% (7.2180 => 7.3470, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5003, std. dev.: 0.0299) MultiSource/Applications/siod/siod: 1.61% (2.1791 => 2.2142, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0916, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.52% (0.8698 => 0.8830, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.5754 => 6.6681, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.3801 => 4.4358, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (4.4433 => 4.4953, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 27.12% (1.8175 => 2.3104, std. dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3893, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7336, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9692, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6799, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (4.1080 => 4.1983, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6469 => 3.7128, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6405, std. dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.75% (0.4657 => 0.3877, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9042, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3511 => 0.3341, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (6.2785 => 6.1845, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -27.36% (0.0848 => 0.0616, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1057, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (20.3410 => 18.6294, std. dev.: 0.0640) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5843, std. dev.: 0.0201) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0957, std. dev.: 0.0273) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2579, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9801, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7878, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2384, std. dev.: 0.0290) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9285, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 13:34:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 15:34:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626203433.2285E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1531?compare_to=1529&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1531, Order: 159218, Start Time: 2012-06-26 19:35:18, End Time: 2012-06-26 20:36:08 To: 1529, Order: 159210, Start Time: 2012-06-26 18:07:28, End Time: 2012-06-26 19:08:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (4 on baseline) Performance Regressions: 2 (33 on baseline) Performance Improvements: 2 (16 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 867 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7442 => 0.7596, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (2.0674 => 2.0917, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.91% (11.0787 => 10.7563, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.42% (0.0869 => 0.0622, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.79% (0.3543 => 0.3819, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.37% (0.3473 => 0.3729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.21% (0.3497 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.19% (0.3561 => 0.3817, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3516 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.04% (0.3694 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.60% (0.3927 => 0.4186, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.58% (0.3828 => 0.4080, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.54% (0.3886 => 0.4140, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (10.4361 => 10.8722, std. dev.: 0.0230) MultiSource/Benchmarks/PAQ8p/paq8p: 3.75% (10.3673 => 10.7563, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 3.69% (0.7326 => 0.7596, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 3.49% (0.5925 => 0.6132, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.48% (0.6030 => 0.6240, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.28% (21.9371 => 22.6576, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4615 => 0.4734, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8172 => 0.8377, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (7.0540 => 7.2280, std. dev.: 0.0115) MultiSource/Applications/spiff/spiff: 1.80% (0.7835 => 0.7976, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (8.1363 => 8.2536, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (7.9617 => 8.0742, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.22% (2.0665 => 2.0917, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (2.2022 => 2.2286, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3145, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.16% (5.0018 => 5.0597, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (9.4845 => 9.5922, std. dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.9449 => 5.0006, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8776, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.39% (2.4116 => 2.4452, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.26% (3.6395 => 3.6852, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.82% (0.8651 => 0.7282, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.23% (5.2763 => 4.7894, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.31% (2.9384 => 2.6941, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.61% (1.1194 => 1.0454, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4809, std. dev.: 0.0229) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.06% (6.6874 => 6.4158, std. dev.: 0.0220) MultiSource/Applications/ClamAV/clamscan: -3.15% (22.1758 => 21.4777, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.55% (5.3526 => 5.2697, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.44% (5.3855 => 5.3077, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.06% (1.7609 => 1.7422, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.01% (0.0864 => 0.0622, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2373 => 1.1138, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.24% (19.9488 => 18.5050, std. dev.: 0.0654) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9183, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6854, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 13:34:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 15:34:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626203441.6261F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1532?compare_to=1527&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1532, Order: 159213, Start Time: 2012-06-26 18:24:52, End Time: 2012-06-26 20:36:16 To: 1527, Order: 159203, Start Time: 2012-06-26 15:42:09, End Time: 2012-06-26 17:57:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 4 (4 on baseline) Performance Regressions: 0 (25 on baseline) Performance Improvements: 1 (3 on baseline) Unchanged Tests: 889 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -30.48% (0.1240 => 0.0862, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.04% (0.3465 => 0.3709, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.02% (0.3446 => 0.3688, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.00% (0.3488 => 0.3732, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.94% (0.3460 => 0.3700, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.89% (0.3442 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.86% (0.3469 => 0.3707, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3496 => 0.3734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.59% (0.3643 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.44% (0.3650 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.36% (0.3724 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.23% (0.5826 => 0.6014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.97% (0.5889 => 0.6064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.64% (0.7171 => 0.7360, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (1.6211 => 1.6608, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (3.5627 => 3.6437, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.5900 => 0.6028, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.09% (1.3152 => 1.3427, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.87% (4.2109 => 4.2896, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (2.0673 => 2.1012, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (1.9694 => 2.0012, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.52% (0.9909 => 1.0060, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (1.9966 => 2.0212, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.22% (1.0781 => 1.0913, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (4.4195 => 4.4707, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.13% (23.5202 => 23.7869, std. dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.83% (2.4764 => 2.4063, std. dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: -2.80% (11.9555 => 11.6206, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -30.43% (0.1239 => 0.0862, std. dev.: 0.0003) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 13:45:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 15:45:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626204519.437F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1533?compare_to=1530&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1533, Order: 159218, Start Time: 2012-06-26 19:50:43, End Time: 2012-06-26 20:46:53 To: 1530, Order: 159213, Start Time: 2012-06-26 18:27:29, End Time: 2012-06-26 19:23:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (4 on baseline) Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Existing Failures: 4 (0 on baseline) Unchanged Tests: 889 (730 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.79% (1.3893 => 1.4141, std. dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2795, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.5818 => 0.6177, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5748 => 0.6082, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7061 => 0.7444, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4062 => 0.4262, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.90% (1.3693 => 1.4364, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.73% (0.3022 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.61% (0.2690 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.60% (0.2628 => 0.2749, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.53% (3.9660 => 4.1458, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.49% (1.9828 => 2.0719, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.49% (0.2696 => 0.2817, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2760 => 0.2883, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.45% (0.2966 => 0.3098, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.7710 => 0.8046, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3453 => 0.3602, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3293 => 0.3419, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.78% (13.8202 => 14.3429, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.74% (0.3580 => 0.3714, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.66% (0.3578 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.62% (0.3646 => 0.3778, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.60% (0.4003 => 0.4147, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 3.59% (0.3789 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.58% (0.3601 => 0.3730, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.55% (0.3663 => 0.3793, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.50% (0.3914 => 0.4051, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.42% (0.3650 => 0.3775, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 3.42% (0.3623 => 0.3747, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (0.4390 => 0.4540, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.30% (0.3940 => 0.4070, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.9199 => 0.9501, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.4563 => 1.4985, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.2193 => 1.2540, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3245 => 1.3620, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 2.73% (16.6129 => 17.0672, std. dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2292 => 1.2627, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.71% (1.1364 => 1.1672, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.66% (0.7506 => 0.7706, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.65% (1.1061 => 1.1354, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1173, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.62% (3.8646 => 3.9658, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9766, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.53% (1.3813 => 1.4162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.45% (7.2180 => 7.3951, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (1.3819 => 1.4150, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.29% (0.7460 => 0.7631, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5728, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (3.6692 => 3.7489, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.8698 => 0.8883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7076, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.01% (14.8535 => 15.1516, std. dev.: 0.0100) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2206, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5212, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.3801 => 4.4567, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2319, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1465, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0514) SingleSource/Benchmarks/Misc/mandel-2: 8.79% (1.2998 => 1.4141, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7297, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (2.8606 => 2.9691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9224, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.24% (4.1080 => 4.2001, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (3.6469 => 3.7071, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6423, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.70% (0.4657 => 0.3926, std. dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0011, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3511 => 0.3353, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.8818 => 0.8550, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (0.9108 => 0.8984, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2120, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -27.24% (0.0848 => 0.0617, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (20.3410 => 18.5883, std. dev.: 0.0483) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5875, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -2.60% (9.3358 => 9.0928, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5096, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9833, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7865, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9276, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 15:02:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 17:02:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626220235.11AD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1534?compare_to=1531&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1534, Order: 159222, Start Time: 2012-06-26 21:03:23, End Time: 2012-06-26 22:04:08 To: 1531, Order: 159218, Start Time: 2012-06-26 19:35:18, End Time: 2012-06-26 20:36:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 2 (0 on baseline) Performance Regressions: 3 (34 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 868 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.56% (10.7563 => 10.9237, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 40.68% (0.0622 => 0.0875, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3089 => 1.3237, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.28% (0.3473 => 0.3726, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 7.09% (0.3497 => 0.3745, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.08% (0.3543 => 0.3794, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3543 => 0.3790, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.82% (0.3561 => 0.3804, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.69% (0.3694 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3828 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3927 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.41% (0.3886 => 0.4135, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.37% (10.3673 => 10.9237, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 4.75% (10.4361 => 10.9319, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 3.45% (0.6030 => 0.6238, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 3.42% (21.9371 => 22.6882, std. dev.: 0.0234) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4615 => 0.4745, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.70% (0.7433 => 0.7634, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7326 => 0.7519, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8172 => 0.8381, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (7.0540 => 7.2306, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.65% (2.2022 => 2.2385, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (7.9617 => 8.0907, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: 1.61% (0.7835 => 0.7961, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (9.4845 => 9.6304, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.35% (8.1363 => 8.2465, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3188, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.22% (5.7591 => 5.8292, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.18% (4.9449 => 5.0031, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (5.0018 => 5.0591, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.83% (26.0924 => 26.8311, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.47% (1.3045 => 1.3237, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.17% (3.6395 => 3.6821, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.73% (0.8651 => 0.7290, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.02% (5.2763 => 4.8004, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.10% (2.9384 => 2.7004, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.66% (1.1194 => 1.0449, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4617, std. dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.09% (6.6874 => 6.4141, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: -3.12% (22.1758 => 21.4844, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.31% (5.3526 => 5.2827, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.26% (5.3855 => 5.3176, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1040, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5563, std. dev.: 0.0343) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9190, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6828, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 15:08:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 17:08:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626220854.2A55F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1535?compare_to=1533&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1535, Order: 159222, Start Time: 2012-06-26 21:13:50, End Time: 2012-06-26 22:10:28 To: 1533, Order: 159218, Start Time: 2012-06-26 19:50:43, End Time: 2012-06-26 20:46:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 4 (0 on baseline) Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 40.84% (0.0617 => 0.0869, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.29% (2.0176 => 2.2655, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5818 => 0.6220, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5748 => 0.6126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.96% (0.7061 => 0.7482, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4328 => 0.4572, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.21% (1.3693 => 1.4407, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.19% (0.4062 => 0.4273, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1986 => 0.2086, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.7710 => 0.8090, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0800, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.61% (0.3578 => 0.3743, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.55% (0.3646 => 0.3812, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.54% (3.9660 => 4.1461, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 4.44% (0.3601 => 0.3761, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 4.38% (0.3789 => 0.3955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.30% (0.4003 => 0.4175, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.26% (0.3663 => 0.3819, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.25% (0.3650 => 0.3805, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 4.22% (0.3623 => 0.3776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.3756 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.06% (0.3940 => 0.4100, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.63% (13.8202 => 14.3221, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4390 => 0.4548, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (0.4379 => 0.4512, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.02% (1.2292 => 1.2663, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.95% (1.2193 => 1.2553, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.93% (1.4563 => 1.4989, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 2.85% (0.7506 => 0.7720, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.3245 => 1.3607, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.71% (1.1364 => 1.1672, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.68% (1.1061 => 1.1357, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 2.65% (16.6129 => 17.0529, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1149, std. dev.: 0.0273) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9620, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.45% (7.2180 => 7.3952, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 2.44% (1.9270 => 1.9740, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.43% (1.3813 => 1.4148, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.3819 => 1.4139, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.7460 => 0.7626, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5756, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.14% (3.6692 => 3.7477, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.8698 => 0.8880, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.01% (14.8535 => 15.1520, std. dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.5754 => 6.6960, std. dev.: 0.0161) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2181, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.3801 => 4.4584, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6135 => 0.6240, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (4.4433 => 4.5145, std. dev.: 0.0093) MultiSource/Applications/d/make_dparser: 1.36% (3.1889 => 3.2322, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.5298 => 14.6799, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1932, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (0.9996 => 1.0798, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7264, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1979, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6469 => 3.7149, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6408, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.23% (0.4657 => 0.3901, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9731, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3511 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.73% (0.6576 => 0.6462, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.91% (1.2308 => 1.1088, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (20.3410 => 18.6092, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3780 => 1.3213, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5514, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: -2.60% (9.3358 => 9.0933, std. dev.: 0.0357) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6080, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9786, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2178, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2215, std. dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9289, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 16:17:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 18:17:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120626231707.682122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1536?compare_to=1532&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1536, Order: 159222, Start Time: 2012-06-26 21:03:17, End Time: 2012-06-26 23:18:41 To: 1532, Order: 159213, Start Time: 2012-06-26 18:24:52, End Time: 2012-06-26 20:36:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 4 (0 on baseline) Performance Regressions: 3 (36 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 887 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.47% (0.9758 => 0.9901, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (2.7390 => 2.7712, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 43.74% (0.0862 => 0.1239, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.31% (0.3792 => 0.4562, std. dev.: 0.0140) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.11% (0.3488 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.93% (0.3442 => 0.3715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3460 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.91% (0.3465 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3446 => 0.3718, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.84% (0.3496 => 0.3770, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3469 => 0.3739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3643 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.59% (0.3650 => 0.3927, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3724 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5826 => 0.6049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.57% (0.5889 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (1.6211 => 1.6697, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.94% (0.7171 => 0.7382, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.78% (3.5627 => 3.6619, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.61% (2.0673 => 2.1212, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.60% (0.9909 => 1.0167, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.54% (1.3152 => 1.3486, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.46% (0.5900 => 0.6045, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (0.5026 => 0.5147, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.12% (4.2109 => 4.3000, std. dev.: 0.0054) MultiSource/Applications/hbd/hbd: 2.10% (0.9697 => 0.9901, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (0.4994 => 0.5095, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (0.5000 => 0.5101, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.59% (1.9694 => 2.0007, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (1.9966 => 2.0276, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.54% (2.7292 => 2.7712, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.52% (1.0781 => 1.0945, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (2.1653 => 2.1948, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.35% (5.5417 => 5.6165, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.32% (23.5202 => 23.8309, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (4.4195 => 4.4738, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.19% (4.6177 => 4.6726, std. dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (2.1013 => 2.1231, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.37% (2.4764 => 2.3682, std. dev.: 0.0271) MultiSource/Applications/kimwitu++/kc: -2.52% (11.9555 => 11.6540, std. dev.: 0.0070) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 16:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 18:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120626233043.D16D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1537?compare_to=1534&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1537, Order: 159229, Start Time: 2012-06-26 22:31:35, End Time: 2012-06-26 23:32:18 To: 1534, Order: 159222, Start Time: 2012-06-26 21:03:23, End Time: 2012-06-26 22:04:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (32 on baseline) Performance Improvements: 2 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 869 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.38% (10.9237 => 11.0740, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.25% (3.7669 => 3.8517, std. dev.: 0.0309) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -5.01% (21.4844 => 20.4083, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: -1.37% (10.9319 => 10.7826, std. dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.82% (10.3673 => 11.0740, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 6.56% (0.3473 => 0.3701, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.46% (0.3543 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.46% (0.3561 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3543 => 0.3769, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.34% (0.3516 => 0.3739, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.31% (0.3694 => 0.3927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.02% (0.3886 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3828 => 0.4052, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.83% (0.3927 => 0.4156, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.37% (21.9371 => 22.6766, std. dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (10.4361 => 10.7826, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.8172 => 0.8427, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4615 => 0.4748, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7433 => 0.7644, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 2.32% (0.6030 => 0.6170, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (7.0540 => 7.2154, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 2.28% (0.5925 => 0.6060, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 1.68% (0.7326 => 0.7449, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.1363 => 8.2522, std. dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (7.9617 => 8.0731, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 1.31% (1.1642 => 1.1794, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (9.4845 => 9.6034, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.2646 => 4.3172, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.9449 => 5.0037, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (5.0018 => 5.0584, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7914, std. dev.: 0.0338) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6395 => 3.6764, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.3045 => 1.3176, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.57% (0.8651 => 0.7304, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.21% (5.2763 => 4.7901, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (2.9384 => 2.6955, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -7.97% (22.1758 => 20.4083, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.46% (1.1194 => 1.0471, std. dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4415, std. dev.: 0.0618) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.44% (6.6874 => 6.3906, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.44% (5.3855 => 5.3078, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.17% (1.2373 => 1.1115, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.58% (19.9488 => 18.4364, std. dev.: 0.0683) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9155, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6883, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 16:33:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 18:33:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120626233301.A81352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1538?compare_to=1535&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1538, Order: 159230, Start Time: 2012-06-26 22:38:01, End Time: 2012-06-26 23:34:36 To: 1535, Order: 159222, Start Time: 2012-06-26 21:13:50, End Time: 2012-06-26 22:10:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.08% (3.7817 => 3.8225, std. dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2798, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.48% (0.5818 => 0.6137, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.31% (0.5748 => 0.6053, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7038 => 0.7409, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.83% (0.3022 => 0.3168, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7061 => 0.7400, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (3.9660 => 4.1525, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 4.68% (0.4062 => 0.4252, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.64% (0.2781 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.7710 => 0.8059, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.35% (0.2782 => 0.2903, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.33% (0.2607 => 0.2720, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.28% (0.3899 => 0.4066, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 4.22% (0.2937 => 0.3061, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.03% (1.9828 => 2.0627, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3453 => 0.3590, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3546, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2761 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.61% (0.2988 => 0.3096, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3868 => 0.3997, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.2193 => 1.2569, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.07% (0.5577 => 0.5748, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1710, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.4563 => 1.5006, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 2.96% (0.3578 => 0.3684, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 2.93% (0.3646 => 0.3753, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 2.93% (0.7506 => 0.7726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.92% (0.4003 => 0.4120, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.88% (16.6129 => 17.0921, std. dev.: 0.0217) SingleSource/UnitTests/ObjC/for-in: 2.88% (0.3789 => 0.3898, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.87% (1.1061 => 1.1379, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (4.9865 => 5.1293, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions: 2.84% (0.3914 => 0.4025, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (3.8646 => 3.9733, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 2.79% (1.9270 => 1.9807, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 2.76% (0.3663 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.69% (0.3940 => 0.4046, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.50% (1.2292 => 1.2599, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (7.2180 => 7.3930, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.39% (1.3819 => 1.4149, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (3.6692 => 3.7550, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2278, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.8535 => 15.1766, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5724, std. dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.5754 => 6.7067, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4623, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6283 => 0.6394, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5196, std. dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2956, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.57% (3.1889 => 3.2391, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1333 => 1.1500, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.5298 => 14.7044, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1229, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.30% (1.8175 => 2.2773, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9996 => 1.0795, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.09% (1.2998 => 1.3919, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7358, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.78% (2.8606 => 2.9687, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1978, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.41% (3.6469 => 3.6982, std. dev.: 0.0090) MultiSource/Benchmarks/llubenchmark/llu: 1.31% (3.7731 => 3.8225, std. dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6448, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std. dev.: 0.0157) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.5627 => 21.0325, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.67% (0.3511 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.8818 => 0.8595, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.34% (20.3410 => 18.4414, std. dev.: 0.1045) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0133) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.47% (1.9762 => 1.9076, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: -2.58% (9.3358 => 9.0946, std. dev.: 0.0427) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6020, std. dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9797, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2585, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7879, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8536, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2379, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.16% (0.9692 => 0.9580, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2376, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 17:56:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 19:56:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627005642.2A6FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1539?compare_to=1538&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1539, Order: 159239, Start Time: 2012-06-27 00:01:37, End Time: 2012-06-27 00:58:16 To: 1538, Order: 159230, Start Time: 2012-06-26 22:38:01, End Time: 2012-06-26 23:34:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (728 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2781, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.46% (0.5818 => 0.6194, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5748 => 0.6103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7061 => 0.7459, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4328 => 0.4556, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.20% (0.7038 => 0.7404, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1986 => 0.2086, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.85% (0.2781 => 0.2916, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.78% (1.3693 => 1.4347, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.7710 => 0.8072, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (3.9660 => 4.1510, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.53% (0.3578 => 0.3740, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.41% (0.3899 => 0.4071, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.37% (0.5265 => 0.5495, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/for-in: 4.35% (0.3789 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.33% (0.3601 => 0.3757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.32% (0.4003 => 0.4176, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.31% (0.3646 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.30% (0.3650 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.29% (0.3663 => 0.3820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.28% (0.2966 => 0.3093, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.27% (0.2765 => 0.2883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 4.26% (0.3940 => 0.4108, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2726 => 0.2841, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.17% (0.3623 => 0.3774, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.9828 => 2.0652, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2761 => 0.2872, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.98% (0.3489 => 0.3628, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.97% (0.3149 => 0.3274, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.95% (0.6959 => 0.7234, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3580 => 0.3721, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.91% (0.4379 => 0.4550, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3546, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.65% (0.9199 => 0.9535, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.35% (0.4390 => 0.4537, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0594 => 1.0939, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5027, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.2193 => 1.2567, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3635, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 2.92% (0.7506 => 0.7725, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1317, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.91% (16.6129 => 17.0960, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.90% (0.5577 => 0.5739, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.87% (1.3819 => 1.4216, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 2.86% (1.9270 => 1.9822, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.86% (1.1061 => 1.1377, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (3.8646 => 3.9743, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.67% (1.3813 => 1.4182, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.46% (1.2292 => 1.2594, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.45% (0.7460 => 0.7643, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (3.6692 => 3.7576, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.40% (7.2180 => 7.3912, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1960, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5846, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2256, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7074, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.80% (4.3801 => 4.4589, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (4.4433 => 4.5207, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2394, std. dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1333 => 1.1504, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.5298 => 14.7043, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (1.5188 => 1.5349, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1229, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.17% (2.0200 => 2.1850, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.07% (1.2998 => 1.3917, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7318, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.22% (4.1080 => 4.1990, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9527, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6442, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.68% (0.4657 => 0.4020, std. dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.5627 => 21.0407, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.36% (0.3511 => 0.3358, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.31% (0.9108 => 0.8989, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.67% (1.2308 => 1.1118, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5549, std. dev.: 0.0170) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std. dev.: 0.0115) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5950, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4462, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.48% (9.3358 => 9.1045, std. dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9789, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (9.9194 => 9.7880, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8525, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2473, std. dev.: 0.0203) MultiSource/Applications/lua/lua: -1.08% (26.5159 => 26.2304, std. dev.: 0.0334) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 17:58:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 19:58:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627005835.D4C612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1540?compare_to=1537&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1540, Order: 159239, Start Time: 2012-06-26 23:59:27, End Time: 2012-06-27 01:00:11 To: 1537, Order: 159229, Start Time: 2012-06-26 22:31:35, End Time: 2012-06-26 23:32:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (29 on baseline) Performance Improvements: 1 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (830 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.04% (11.0740 => 10.7371, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3543 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3473 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.63% (0.3516 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.61% (0.3497 => 0.3728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.55% (0.3543 => 0.3775, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.40% (0.3561 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.25% (0.3694 => 0.3925, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions: 6.14% (0.3828 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.09% (0.3927 => 0.4166, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.00% (0.3886 => 0.4119, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (10.4361 => 10.8269, std. dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: 3.57% (10.3673 => 10.7371, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 3.16% (21.9371 => 22.6293, std. dev.: 0.0187) SingleSource/UnitTests/ObjC++/Hello: 2.87% (0.5925 => 0.6095, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.72% (0.6030 => 0.6194, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7433 => 0.7623, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 2.51% (0.7326 => 0.7510, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (7.0540 => 7.1936, std. dev.: 0.0315) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.1363 => 8.2401, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.9449 => 5.0039, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3144, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (7.9617 => 8.0516, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.12% (9.4845 => 9.5903, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (5.0018 => 5.0555, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.50% (26.0924 => 26.7456, std. dev.: 0.0543) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5346, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.29% (3.6395 => 3.6863, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.52% (0.8651 => 0.7308, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.95% (5.2763 => 4.8039, std. dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: -8.08% (22.1758 => 20.3851, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.07% (2.9384 => 2.7014, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.17% (1.1194 => 1.0503, std. dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5334, std. dev.: 0.0815) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.26% (6.6874 => 6.4025, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.73% (5.3855 => 5.2925, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.08% (5.3526 => 5.2949, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1040, std. dev.: 0.0336) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.20% (19.9488 => 18.5122, std. dev.: 0.0658) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9180, std. dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6952, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 18:59:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 20:59:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627015930.A87392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1541?compare_to=1536&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1541, Order: 159238, Start Time: 2012-06-26 23:45:40, End Time: 2012-06-27 02:01:05 To: 1536, Order: 159222, Start Time: 2012-06-26 21:03:17, End Time: 2012-06-26 23:18:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (24 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 7.49% (0.3496 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.44% (0.3442 => 0.3698, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.43% (0.3488 => 0.3747, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3465 => 0.3722, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.40% (0.3446 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3460 => 0.3716, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3469 => 0.3722, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.14% (0.3643 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.07% (0.3650 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.93% (0.3724 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.60% (0.5826 => 0.6036, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.43% (0.5889 => 0.6091, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (0.5026 => 0.5171, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 2.73% (0.7171 => 0.7367, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.5900 => 0.6034, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (1.6211 => 1.6571, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (3.5627 => 3.6383, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.86% (0.9909 => 1.0093, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0673 => 2.1045, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (1.3152 => 1.3371, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.64% (4.2109 => 4.2799, std. dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 1.46% (23.5202 => 23.8635, std. dev.: 0.0090) MultiSource/Applications/hbd/hbd: 1.17% (0.9697 => 0.9810, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.02% (1.9694 => 1.9895, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.69% (2.4764 => 2.3850, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -2.83% (11.9555 => 11.6167, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.4253 => 0.4152, std. dev.: 0.0012) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 19:22:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 21:22:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627022249.5E1932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1542?compare_to=1539&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1542, Order: 159245, Start Time: 2012-06-27 01:27:39, End Time: 2012-06-27 02:24:23 To: 1539, Order: 159239, Start Time: 2012-06-27 00:01:37, End Time: 2012-06-27 00:58:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.93% (2.0176 => 2.2784, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5748 => 0.6126, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.99% (0.7061 => 0.7484, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7038 => 0.7413, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.91% (0.2607 => 0.2735, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.89% (0.2782 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.87% (1.3693 => 1.4360, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.73% (0.3022 => 0.3165, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1514, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.63% (0.2937 => 0.3073, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.53% (0.3578 => 0.3740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.39% (0.3646 => 0.3806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.37% (0.4003 => 0.4178, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.7710 => 0.8047, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.37% (0.5265 => 0.5495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.35% (0.3789 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.33% (1.9828 => 2.0687, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 4.33% (0.3601 => 0.3757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3149 => 0.3285, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.28% (0.2966 => 0.3093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.27% (0.3650 => 0.3806, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.26% (0.3663 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 4.22% (0.3623 => 0.3776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.16% (0.3940 => 0.4104, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.13% (0.3489 => 0.3633, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3107 => 0.3235, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.98% (0.6959 => 0.7236, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3580 => 0.3722, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3547, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2988 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4379 => 0.4532, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.23% (0.4390 => 0.4532, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.4563 => 1.5013, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1364 => 1.1711, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.02% (16.6129 => 17.1138, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.2193 => 1.2558, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1346, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5577 => 0.5742, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.90% (1.1061 => 1.1382, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8646 => 3.9756, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.80% (0.3755 => 0.3860, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.77% (1.9270 => 1.9803, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.3813 => 1.4181, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4172, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2292 => 1.2602, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.7460 => 0.7648, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (7.2180 => 7.3925, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (3.6692 => 3.7572, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1933, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2274, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5784, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.8698 => 0.8889, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7074, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.3801 => 4.4597, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (4.4433 => 4.5205, std. dev.: 0.0072) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2436, std. dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1333 => 1.1494, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6917, std. dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4425, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1237, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2779, std. dev.: 0.0457) SingleSource/Benchmarks/Misc/mandel-2: 8.27% (1.2998 => 1.4073, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.16% (2.0200 => 2.1849, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7115, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6812, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (4.1080 => 4.1969, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 1.72% (3.6975 => 3.7610, std. dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.51% (3.6469 => 3.7020, std. dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6421, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std. dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.5627 => 21.0491, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.39% (0.3511 => 0.3357, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2308 => 1.1061, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.79% (20.3410 => 18.5539, std. dev.: 0.0649) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.53% (9.3358 => 9.0995, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6047, std. dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4988, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.52% (3.0263 => 2.9804, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8533, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2444, std. dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 19:27:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 21:27:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627022705.B12FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1543?compare_to=1540&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1543, Order: 159245, Start Time: 2012-06-27 01:27:47, End Time: 2012-06-27 02:28:40 To: 1540, Order: 159239, Start Time: 2012-06-26 23:59:27, End Time: 2012-06-27 01:00:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (28 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (832 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.46% (3.9195 => 3.8623, std. dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 6.77% (0.3473 => 0.3708, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.60% (0.3543 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.60% (0.3543 => 0.3777, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3497 => 0.3727, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.54% (0.3516 => 0.3746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.46% (0.3561 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.28% (0.3694 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3828 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.94% (0.3886 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.91% (0.3927 => 0.4159, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.82% (10.3673 => 10.7634, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (10.4361 => 10.8145, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 3.18% (21.9371 => 22.6344, std. dev.: 0.0386) SingleSource/UnitTests/ObjC++/property-reference-object: 2.95% (0.6030 => 0.6208, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.87% (0.5925 => 0.6095, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (0.7433 => 0.7639, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7326 => 0.7481, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.11% (7.0540 => 7.2030, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (8.1363 => 8.2394, std. dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (7.9617 => 8.0606, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (9.4845 => 9.5923, std. dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.2646 => 4.3107, std. dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7591 => 5.8188, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8647, std. dev.: 0.0183) MultiSource/Benchmarks/llubenchmark/llu: 2.23% (3.7781 => 3.8623, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (3.6395 => 3.6759, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.44% (0.8651 => 0.7315, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.92% (5.2763 => 4.8055, std. dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: -8.00% (22.1758 => 20.4011, std. dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.94% (2.9384 => 2.7051, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.24% (1.1194 => 1.0496, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -4.87% (54.1659 => 51.5279, std. dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.14% (6.6874 => 6.4105, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.49% (5.3855 => 5.3054, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5903, std. dev.: 0.0503) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9235, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6883, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 20:46:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 22:46:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627034630.A4E132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1544?compare_to=1542&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1544, Order: 159250, Start Time: 2012-06-27 02:51:22, End Time: 2012-06-27 03:48:05 To: 1542, Order: 159245, Start Time: 2012-06-27 01:27:39, End Time: 2012-06-27 02:24:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (730 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.46% (3.7610 => 3.7060, std. dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2794, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5818 => 0.6229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5748 => 0.6139, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7061 => 0.7503, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4328 => 0.4579, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.4062 => 0.4279, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.29% (0.7038 => 0.7410, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.25% (0.3578 => 0.3766, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.15% (0.4003 => 0.4209, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.12% (0.3650 => 0.3837, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 5.05% (0.3601 => 0.3783, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 5.03% (0.3914 => 0.4111, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.01% (0.3789 => 0.3979, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 4.97% (0.3663 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.97% (0.3623 => 0.3803, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.87% (0.3940 => 0.4132, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.86% (3.9660 => 4.1586, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0774, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3485 => 0.3651, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.7710 => 0.8058, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.11% (0.6959 => 0.7245, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3708, std. dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.71% (0.9199 => 0.9540, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4390 => 0.4552, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.3245 => 1.3664, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.4563 => 1.5022, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.14% (0.5577 => 0.5752, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1718, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.10% (0.7506 => 0.7739, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.10% (4.9865 => 5.1409, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 3.09% (16.6129 => 17.1265, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.01% (1.1061 => 1.1394, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (3.8646 => 3.9800, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.94% (1.9270 => 1.9837, std. dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2292 => 1.2650, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.84% (1.3813 => 1.4205, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (7.2180 => 7.4013, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.7460 => 0.7647, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.49% (1.3819 => 1.4163, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7593, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.8698 => 0.8910, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5955, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2007, std. dev.: 0.0159) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2291, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7194, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.3801 => 4.4673, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (4.4433 => 4.5235, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6283 => 0.6392, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1333 => 1.1519, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.61% (3.1889 => 3.2401, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2946, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.24% (14.5298 => 14.7104, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.00% (2.1007 => 2.1218, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0470) SingleSource/Benchmarks/Misc/mandel-2: 8.86% (1.2998 => 1.4150, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7347, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9699, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9176, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1979, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7040, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6449, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.59% (22.5627 => 21.0750, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.33% (0.3511 => 0.3359, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1010, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (20.3410 => 18.6144, std. dev.: 0.0415) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5886, std. dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.46% (9.3358 => 9.1060, std. dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5118, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9784, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7876, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8525, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2464, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8449, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 20:55:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 22:55:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627035517.183B92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1545?compare_to=1543&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1545, Order: 159250, Start Time: 2012-06-27 02:55:49, End Time: 2012-06-27 03:56:52 To: 1543, Order: 159245, Start Time: 2012-06-27 01:27:47, End Time: 2012-06-27 02:28:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 2 (32 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 870 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.47% (0.8297 => 0.8419, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.17% (1.1034 => 1.1163, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.52% (10.7634 => 10.5999, std. dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.06% (0.3473 => 0.3753, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.93% (0.3543 => 0.3824, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3497 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.82% (0.3516 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3561 => 0.3839, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3543 => 0.3818, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3694 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.21% (0.3828 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.15% (0.3886 => 0.4164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.13% (0.3927 => 0.4207, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (10.4361 => 10.8180, std. dev.: 0.0232) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.59% (0.5925 => 0.6138, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.37% (21.9371 => 22.6753, std. dev.: 0.0172) SingleSource/UnitTests/ObjC++/property-reference: 3.36% (0.7326 => 0.7572, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.8172 => 0.8419, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7433 => 0.7629, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.32% (0.4615 => 0.4722, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.24% (10.3673 => 10.5999, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.10% (7.0540 => 7.2018, std. dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.78% (7.9617 => 8.1031, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.66% (0.7835 => 0.7965, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.64% (8.1363 => 8.2700, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (9.4845 => 9.6233, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.41% (5.0018 => 5.0722, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (4.2646 => 4.3225, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.9449 => 5.0075, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8288, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.11% (3.3354 => 3.3724, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 1.06% (2.0273 => 2.0488, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7651, std. dev.: 0.0381) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.35% (0.8651 => 0.7323, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.91% (5.2763 => 4.8063, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.08% (2.9384 => 2.7010, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.83% (22.1758 => 20.4395, std. dev.: 0.0390) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.19% (1.1194 => 1.0501, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4782, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.32% (6.6874 => 6.3982, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.47% (5.3855 => 5.3064, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.94% (19.9488 => 18.5650, std. dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9123, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6870, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 21:41:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 26 Jun 2012 23:41:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627044156.22DF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1546?compare_to=1541&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1546, Order: 159248, Start Time: 2012-06-27 02:28:01, End Time: 2012-06-27 04:43:28 To: 1541, Order: 159238, Start Time: 2012-06-26 23:45:40, End Time: 2012-06-27 02:01:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (31 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 893 (861 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.17% (2.3850 => 2.3570, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.91% (0.3792 => 0.4471, std. dev.: 0.0146) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3496 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.07% (0.3446 => 0.3724, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.05% (0.3465 => 0.3744, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3442 => 0.3718, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3488 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3460 => 0.3736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.93% (0.3469 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.70% (0.3650 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.63% (0.3643 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3724 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.00% (0.5826 => 0.6059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.5889 => 0.6116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7171 => 0.7394, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (0.5026 => 0.5159, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.56% (0.4029 => 0.4132, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (1.6211 => 1.6625, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (3.5627 => 3.6454, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.5900 => 0.6029, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (1.3152 => 1.3424, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (2.0673 => 2.1100, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 2.05% (0.9909 => 1.0112, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.85% (4.2109 => 4.2887, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.37% (1.9694 => 1.9963, std. dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (2.7292 => 2.7648, std. dev.: 0.0091) MultiSource/Applications/hbd/hbd: 1.28% (0.9697 => 0.9821, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (1.9966 => 2.0216, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 1.18% (23.5202 => 23.7969, std. dev.: 0.0220) MultiSource/Applications/d/make_dparser: 1.13% (1.0781 => 1.0903, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.03% (4.4195 => 4.4652, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.8036 => 2.8332, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.82% (2.4764 => 2.3570, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: -2.77% (11.9555 => 11.6242, std. dev.: 0.0065) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 22:10:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 00:10:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627051005.1B3462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1547?compare_to=1544&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1547, Order: 159251, Start Time: 2012-06-27 04:15:03, End Time: 2012-06-27 05:11:39 To: 1544, Order: 159250, Start Time: 2012-06-27 02:51:22, End Time: 2012-06-27 03:48:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2783, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.12% (0.5818 => 0.6232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.82% (0.5748 => 0.6140, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.30% (0.7061 => 0.7506, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7038 => 0.7413, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.29% (0.4062 => 0.4277, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.23% (0.3578 => 0.3765, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.15% (0.3789 => 0.3984, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 5.10% (0.3646 => 0.3832, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: 5.08% (0.3601 => 0.3784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.05% (0.3663 => 0.3848, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.99% (0.3650 => 0.3832, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 4.95% (0.4003 => 0.4201, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 4.94% (0.3623 => 0.3802, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.94% (1.3693 => 1.4369, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 4.93% (0.3914 => 0.4107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.7710 => 0.8086, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.82% (0.3940 => 0.4130, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (3.9660 => 4.1561, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.73% (1.9828 => 2.0766, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3580 => 0.3737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.15% (0.6959 => 0.7248, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3700, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.67% (0.9199 => 0.9537, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4390 => 0.4548, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.3245 => 1.3694, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.0594 => 1.0948, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.4563 => 1.5033, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 3.17% (16.6129 => 17.1397, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.9865 => 5.1394, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.01% (1.1061 => 1.1394, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.00% (0.7506 => 0.7731, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (3.8646 => 3.9784, std. dev.: 0.0076) MultiSource/Applications/treecc/treecc: 2.89% (1.9270 => 1.9827, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.2292 => 1.2646, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.84% (1.3819 => 1.4211, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.79% (1.3813 => 1.4198, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.58% (7.2180 => 7.4044, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (3.6692 => 3.7635, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2078, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5991, std. dev.: 0.0063) MultiSource/Applications/siod/siod: 2.25% (2.1791 => 2.2281, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.11% (6.5754 => 6.7143, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.3801 => 4.4694, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6135 => 0.6259, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5243, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2443, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.40% (14.5298 => 14.7331, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0539) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.61% (2.0200 => 2.1939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.51% (1.2998 => 1.4104, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7124, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (2.8606 => 2.9697, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8289, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.18% (4.1080 => 4.1974, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7107, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1935, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6418, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std. dev.: 0.0167) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0366, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1010, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.81% (20.3410 => 18.5496, std. dev.: 0.0456) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3038, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5761, std. dev.: 0.0208) MultiSource/Applications/minisat/minisat: -2.56% (9.3358 => 9.0969, std. dev.: 0.0399) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2605, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9828, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7877, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8577, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2463, std. dev.: 0.0070) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2420, std. dev.: 0.0265) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 22:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 00:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627052324.724CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1548?compare_to=1545&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1548, Order: 159251, Start Time: 2012-06-27 04:24:00, End Time: 2012-06-27 05:24:59 To: 1545, Order: 159250, Start Time: 2012-06-27 02:55:49, End Time: 2012-06-27 03:56:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.90% (0.3543 => 0.3823, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3543 => 0.3820, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3561 => 0.3838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3694 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3828 => 0.4108, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: 7.16% (0.3927 => 0.4208, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 7.10% (0.3886 => 0.4162, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.70% (0.6030 => 0.6253, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.4361 => 10.8199, std. dev.: 0.0170) SingleSource/UnitTests/ObjC++/Hello: 3.63% (0.5925 => 0.6140, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.51% (21.9371 => 22.7065, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.8172 => 0.8369, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 2.28% (10.3673 => 10.6040, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (7.0540 => 7.2096, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (7.9617 => 8.0949, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.1363 => 8.2713, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.39% (4.2646 => 4.3238, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0133, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (9.4845 => 9.6155, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.36% (5.0018 => 5.0697, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.23% (5.7591 => 5.8302, std. dev.: 0.0154) MultiSource/Applications/treecc/treecc: 1.19% (2.0273 => 2.0514, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.15% (3.3354 => 3.3739, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2265, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1861 => 1.1981, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7778, std. dev.: 0.0375) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (1.5086 => 1.5401, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6395 => 3.6777, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.26% (0.8651 => 0.7331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.95% (5.2763 => 4.8042, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.05% (2.9384 => 2.7018, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -7.82% (22.1758 => 20.4411, std. dev.: 0.0347) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.20% (1.1194 => 1.0500, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4708, std. dev.: 0.0444) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.33% (6.6874 => 6.3981, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.55% (5.3855 => 5.3018, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2373 => 1.1101, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6205, std. dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9261, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6883, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 23:42:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 01:42:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627064204.132AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1549?compare_to=1547&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1549, Order: 159252, Start Time: 2012-06-27 05:47:00, End Time: 2012-06-27 06:43:38 To: 1547, Order: 159251, Start Time: 2012-06-27 04:15:03, End Time: 2012-06-27 05:11:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (730 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2775, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.13% (0.5818 => 0.6233, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5748 => 0.6135, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.30% (0.7061 => 0.7506, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.7038 => 0.7419, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.23% (0.3578 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.12% (0.3789 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.11% (0.3601 => 0.3785, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.08% (0.3623 => 0.3807, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.04% (1.3693 => 1.4383, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.02% (0.3663 => 0.3847, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.99% (0.3650 => 0.3832, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.98% (0.3914 => 0.4109, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 4.95% (0.4003 => 0.4201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.9828 => 2.0789, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.78% (3.9660 => 4.1554, std. dev.: 0.0120) SingleSource/UnitTests/ObjC/property: 4.77% (0.3940 => 0.4128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.72% (0.7710 => 0.8074, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.48% (0.5265 => 0.5501, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.01% (0.6959 => 0.7238, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3739, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4390 => 0.4552, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9199 => 0.9534, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.2193 => 1.2583, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.20% (16.6129 => 17.1437, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.17% (1.1364 => 1.1724, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.4563 => 1.5022, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3660, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.13% (0.7506 => 0.7741, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.11% (0.4379 => 0.4515, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.9865 => 5.1387, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 3.03% (3.8646 => 3.9816, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 2.97% (1.1061 => 1.1390, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.95% (1.2292 => 1.2655, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.86% (1.9270 => 1.9822, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.3813 => 1.4206, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.70% (1.3819 => 1.4192, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.59% (7.2180 => 7.4053, std. dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (0.7460 => 0.7653, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (3.6692 => 3.7617, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8698 => 0.8912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.2842 => 13.5931, std. dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 2.32% (14.8535 => 15.1987, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.5754 => 6.7186, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2256, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.3801 => 4.4700, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.4433 => 4.5258, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2393, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.56% (1.2749 => 1.2948, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.41% (14.5298 => 14.7352, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1225, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.35% (1.8175 => 2.2783, std. dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.62% (1.2998 => 1.3859, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7384, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.13% (4.1080 => 4.1957, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6469 => 3.7131, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1935, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9518, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6450, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.22% (0.4657 => 0.3948, std. dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0384, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.30% (0.3511 => 0.3360, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5163, std. dev.: 0.0188) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0213) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5843, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.27% (9.3358 => 9.1237, std. dev.: 0.0367) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7874, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.30% (28.2225 => 27.8558, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jun 26 23:51:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 01:51:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627065130.9C6572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1550?compare_to=1548&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1550, Order: 159252, Start Time: 2012-06-27 05:52:13, End Time: 2012-06-27 06:53:05 To: 1548, Order: 159251, Start Time: 2012-06-27 04:24:00, End Time: 2012-06-27 05:24:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.05% (10.6040 => 10.7153, std. dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3543 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3473 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.36% (0.3561 => 0.3823, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.32% (0.3497 => 0.3753, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.28% (0.3543 => 0.3801, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.28% (0.3516 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.09% (0.3694 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.66% (0.3886 => 0.4145, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.54% (0.3927 => 0.4184, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.4361 => 10.8198, std. dev.: 0.0191) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.6030 => 0.6236, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (10.3673 => 10.7153, std. dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 3.34% (0.5925 => 0.6123, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.30% (21.9371 => 22.6614, std. dev.: 0.0163) SingleSource/UnitTests/ObjC++/property-reference: 3.18% (0.7326 => 0.7559, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.8172 => 0.8371, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.43% (0.4615 => 0.4727, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (7.0540 => 7.1961, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.1363 => 8.2511, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (7.9617 => 8.0678, std. dev.: 0.0175) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (9.4845 => 9.5984, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (5.0018 => 5.0582, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (4.2646 => 4.3126, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.05% (5.7591 => 5.8198, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (4.9449 => 4.9960, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.83% (26.0924 => 26.8319, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6395 => 3.6810, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.11% (0.8651 => 0.7257, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.14% (5.2763 => 4.7938, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.23% (2.9384 => 2.6966, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.95% (22.1758 => 20.4121, std. dev.: 0.0574) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (1.1194 => 1.0469, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4807, std. dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.37% (6.6874 => 6.3953, std. dev.: 0.0165) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.81% (5.3855 => 5.2878, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (5.3526 => 5.2983, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1120, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5582, std. dev.: 0.0435) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9210, std. dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6893, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 00:26:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 02:26:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627072638.D53B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1551?compare_to=1546&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1551, Order: 159251, Start Time: 2012-06-27 05:10:30, End Time: 2012-06-27 07:28:13 To: 1546, Order: 159248, Start Time: 2012-06-27 02:28:01, End Time: 2012-06-27 04:43:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 893 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -6.51% (0.2413 => 0.2256, std. dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.15% (0.3460 => 0.3742, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3496 => 0.3779, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.05% (0.3465 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.04% (0.3446 => 0.3723, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3488 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.90% (0.3442 => 0.3714, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.87% (0.3469 => 0.3742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3643 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.63% (0.3724 => 0.4008, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.59% (0.3650 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.95% (0.5826 => 0.6056, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 3.75% (0.5889 => 0.6110, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 3.15% (0.7171 => 0.7397, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.90% (0.5900 => 0.6071, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (0.5026 => 0.5155, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (1.6211 => 1.6611, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (3.5627 => 3.6440, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (0.4994 => 0.5106, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (2.0673 => 2.1117, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (1.3152 => 1.3423, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (1.9694 => 1.9999, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 1.27% (0.9697 => 0.9820, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (2.7292 => 2.7623, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.17% (23.5202 => 23.7961, std. dev.: 0.0344) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (1.9966 => 2.0172, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (4.4195 => 4.4647, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.72% (2.4764 => 2.3596, std. dev.: 0.0308) MultiSource/Applications/kimwitu++/kc: -2.80% (11.9555 => 11.6206, std. dev.: 0.0138) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 01:09:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 03:09:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627080949.2AC3C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1552?compare_to=1549&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1552, Order: 159253, Start Time: 2012-06-27 07:14:21, End Time: 2012-06-27 08:11:23 To: 1549, Order: 159252, Start Time: 2012-06-27 05:47:00, End Time: 2012-06-27 06:43:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5818 => 0.6231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.91% (0.5748 => 0.6145, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 6.29% (0.7061 => 0.7505, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.7038 => 0.7433, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.4062 => 0.4279, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 5.23% (0.3578 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.23% (0.3789 => 0.3987, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.16% (0.3663 => 0.3852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.13% (1.3693 => 1.4395, std. dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-2: 5.08% (0.3601 => 0.3784, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.07% (0.3650 => 0.3835, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.01% (0.3914 => 0.4110, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.00% (0.3623 => 0.3804, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.95% (0.4003 => 0.4201, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.90% (0.3940 => 0.4133, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.88% (1.9828 => 2.0796, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.79% (0.3485 => 0.3652, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.72% (3.9660 => 4.1533, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.66% (0.3580 => 0.3747, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.62% (0.7710 => 0.8066, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.51% (0.3192 => 0.3336, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2988 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.6959 => 0.7240, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3707, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4390 => 0.4551, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4379 => 0.4519, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3668, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1364 => 1.1726, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 3.15% (16.6129 => 17.1361, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.2193 => 1.2576, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.11% (1.4563 => 1.5016, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.08% (4.9865 => 5.1402, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.98% (0.7506 => 0.7730, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (3.8646 => 3.9795, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5577 => 0.5742, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.85% (1.9270 => 1.9819, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.81% (1.3813 => 1.4201, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.3819 => 1.4201, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (7.2180 => 7.4084, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.7460 => 0.7651, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (3.6692 => 3.7620, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2216, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.8698 => 0.8911, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5992, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7145, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.04% (0.6135 => 0.6260, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.01% (4.3801 => 4.4683, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.4433 => 4.5295, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6283 => 0.6399, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.69% (3.1889 => 3.2428, std. dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2956, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1333 => 1.1505, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.5298 => 14.7113, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 1.09% (16.2614 => 16.4391, std. dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.96% (1.8175 => 2.2893, std. dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1871, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3959, std. dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7361, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.83% (2.8606 => 2.9701, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6811, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.19% (4.1080 => 4.1978, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7035, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.77% (22.5627 => 21.0351, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.41% (0.3511 => 0.3356, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2308 => 1.1030, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6073, std. dev.: 0.0373) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0144) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5964, std. dev.: 0.0195) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0980, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2551, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9798, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7866, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8517, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2420, std. dev.: 0.0092) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2476, std. dev.: 0.0322) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 01:23:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 03:23:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627082335.32F8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1553?compare_to=1550&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1553, Order: 159253, Start Time: 2012-06-27 07:24:11, End Time: 2012-06-27 08:25:10 To: 1550, Order: 159252, Start Time: 2012-06-27 05:52:13, End Time: 2012-06-27 06:53:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (31 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (828 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3473 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.32% (0.3497 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3543 => 0.3800, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.25% (0.3561 => 0.3819, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.22% (0.3516 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.93% (0.3694 => 0.3950, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3828 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.67% (0.3927 => 0.4189, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.61% (0.3886 => 0.4143, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (10.4361 => 10.8173, std. dev.: 0.0177) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5925 => 0.6128, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.6030 => 0.6235, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (10.3673 => 10.7161, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.29% (21.9371 => 22.6587, std. dev.: 0.0214) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7326 => 0.7513, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.27% (0.7835 => 0.8013, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (7.0540 => 7.1956, std. dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.59% (8.1363 => 8.2659, std. dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (7.9617 => 8.0683, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.5415 => 1.5607, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.2646 => 4.3161, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (9.4845 => 9.5985, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.9449 => 5.0038, std. dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8267, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.0018 => 5.0568, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.94% (26.0924 => 26.8598, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6395 => 3.6779, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.04% (0.8651 => 0.7263, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.18% (5.2763 => 4.7919, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (2.9384 => 2.6964, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.97% (22.1758 => 20.4093, std. dev.: 0.0340) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (1.1194 => 1.0469, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4582, std. dev.: 0.0534) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3897, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.82% (5.3855 => 5.2876, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.13% (5.3526 => 5.2919, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1010, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5319, std. dev.: 0.0651) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9267, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 02:33:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 04:33:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627093357.5702C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1554?compare_to=1552&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1554, Order: 159254, Start Time: 2012-06-27 08:38:36, End Time: 2012-06-27 09:35:30 To: 1552, Order: 159253, Start Time: 2012-06-27 07:14:21, End Time: 2012-06-27 08:11:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (730 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.13% (0.3850 => 0.4702, std. dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2781, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5818 => 0.6229, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.77% (0.5748 => 0.6137, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7061 => 0.7507, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.58% (0.7038 => 0.7431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 5.23% (0.3578 => 0.3765, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.12% (1.3693 => 1.4394, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.11% (0.7710 => 0.8104, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 5.09% (0.3789 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.08% (0.3601 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.07% (0.3650 => 0.3835, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 5.05% (0.3663 => 0.3848, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.98% (0.3899 => 0.4093, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 4.97% (0.4003 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.96% (0.3914 => 0.4108, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 4.91% (0.3623 => 0.3801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.91% (1.9828 => 2.0801, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.82% (0.3940 => 0.4130, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (3.9660 => 4.1568, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5265 => 0.5506, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.19% (0.3534 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.17% (0.6959 => 0.7249, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.02% (13.8202 => 14.3760, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9199 => 0.9534, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.2193 => 1.2611, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4379 => 0.4522, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1493, std. dev.: 0.0224) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.25% (1.1364 => 1.1733, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.19% (0.5577 => 0.5755, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (1.4563 => 1.5026, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.16% (0.7506 => 0.7743, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.14% (16.6129 => 17.1352, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.02% (1.1061 => 1.1395, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (3.8646 => 3.9799, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.98% (1.2292 => 1.2658, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 2.89% (1.9270 => 1.9826, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.80% (1.3813 => 1.4200, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.67% (7.2180 => 7.4108, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.3819 => 1.4184, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.64% (0.7460 => 0.7657, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.8698 => 0.8915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2205, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7588, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6018, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 2.31% (2.1791 => 2.2295, std. dev.: 0.0180) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (6.5754 => 6.7161, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4664, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5242, std. dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2443, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.65% (1.1333 => 1.1520, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.30% (14.5298 => 14.7184, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.14% (16.2614 => 16.4472, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (2.1007 => 2.1223, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.19% (2.0200 => 2.1855, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4001, std. dev.: 0.0153) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7359, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.83% (2.8606 => 2.9701, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6775, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.17% (4.1080 => 4.1972, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (3.6469 => 3.7011, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6437, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.5627 => 21.0418, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (0.9108 => 0.9007, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (20.3410 => 18.6312, std. dev.: 0.0279) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -2.64% (9.3358 => 9.0893, std. dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5971, std. dev.: 0.0194) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9825, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7871, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8521, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2352, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 02:51:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 04:51:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627095119.E2D222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1555?compare_to=1553&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1555, Order: 159254, Start Time: 2012-06-27 08:52:24, End Time: 2012-06-27 09:52:55 To: 1553, Order: 159253, Start Time: 2012-06-27 07:24:11, End Time: 2012-06-27 08:25:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (32 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.47% (1.1010 => 1.1172, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3473 => 0.3738, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3516 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.32% (0.3497 => 0.3753, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.31% (0.3543 => 0.3802, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3543 => 0.3800, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 7.22% (0.3561 => 0.3818, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 6.95% (0.3927 => 0.4200, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 6.93% (0.3694 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.74% (0.3828 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.61% (0.3886 => 0.4143, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (10.4361 => 10.8148, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5925 => 0.6124, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.35% (10.3673 => 10.7151, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 3.31% (21.9371 => 22.6622, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7433 => 0.7627, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.61% (0.7326 => 0.7517, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.8172 => 0.8348, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (7.0540 => 7.1939, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.57% (0.7835 => 0.7958, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.1363 => 8.2511, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3217, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (7.9617 => 8.0663, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (9.4845 => 9.5955, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.16% (5.7591 => 5.8260, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (4.9449 => 5.0000, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.06% (5.0018 => 5.0548, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.03% (2.0273 => 2.0481, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.88% (26.0924 => 26.8431, std. dev.: 0.0169) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5373, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6395 => 3.6774, std. dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.09% (0.8651 => 0.7259, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.18% (5.2763 => 4.7920, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.16% (2.9384 => 2.6985, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -7.98% (22.1758 => 20.4061, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.49% (1.1194 => 1.0468, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4954, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.50% (6.6874 => 6.3863, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.78% (5.3855 => 5.2895, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.15% (5.3526 => 5.2913, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1172, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.56% (19.9488 => 18.4402, std. dev.: 0.0704) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9179, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6913, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 03:11:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 05:11:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627101126.118132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1556?compare_to=1551&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1556, Order: 159254, Start Time: 2012-06-27 07:57:36, End Time: 2012-06-27 10:13:01 To: 1551, Order: 159251, Start Time: 2012-06-27 05:10:30, End Time: 2012-06-27 07:28:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (28 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 893 (863 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.38% (0.2256 => 0.2400, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3446 => 0.3730, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3465 => 0.3750, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.13% (0.3469 => 0.3751, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3496 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3442 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3488 => 0.3768, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3460 => 0.3736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.78% (0.3650 => 0.3934, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 7.63% (0.3643 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.3724 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.74% (0.5826 => 0.6044, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.62% (0.5889 => 0.6102, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.43% (1.6211 => 1.6605, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.36% (0.7171 => 0.7340, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (3.5627 => 3.6444, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.5900 => 0.6032, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (0.5026 => 0.5128, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (2.0673 => 2.1092, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.94% (1.3152 => 1.3407, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.85% (0.9909 => 1.0092, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.81% (4.2109 => 4.2873, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.30% (1.9694 => 1.9950, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.27% (0.9697 => 0.9820, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.26% (23.5202 => 23.8155, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (1.9966 => 2.0200, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (2.7292 => 2.7595, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (4.4195 => 4.4675, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.03% (1.0781 => 1.0892, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.75% (2.4764 => 2.3587, std. dev.: 0.0280) MultiSource/Applications/kimwitu++/kc: -2.66% (11.9555 => 11.6379, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.47% (2.0820 => 2.0513, std. dev.: 0.0039) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 03:57:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 05:57:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627105740.6495C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1557?compare_to=1554&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1557, Order: 159256, Start Time: 2012-06-27 10:02:31, End Time: 2012-06-27 10:59:15 To: 1554, Order: 159254, Start Time: 2012-06-27 08:38:36, End Time: 2012-06-27 09:35:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.01% (1.3117 => 1.3249, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.81% (0.5818 => 0.6214, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5748 => 0.6119, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7061 => 0.7481, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7038 => 0.7396, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 5.01% (1.3693 => 1.4379, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.95% (0.3578 => 0.3755, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.88% (0.3789 => 0.3974, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.78% (0.3663 => 0.3838, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.77% (0.3646 => 0.3820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.7710 => 0.8075, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.69% (0.3601 => 0.3770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3899 => 0.4081, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.66% (0.3650 => 0.3820, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.66% (1.9828 => 2.0751, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 4.64% (0.3623 => 0.3791, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (3.9660 => 4.1495, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.62% (0.4003 => 0.4188, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.5265 => 0.5503, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.42% (0.3940 => 0.4114, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4016 => 0.4185, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.6959 => 0.7240, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.3534 => 0.3672, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.80% (13.8202 => 14.3449, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9199 => 0.9526, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5037, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.14% (0.7506 => 0.7742, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.01% (16.6129 => 17.1129, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (4.9865 => 5.1365, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.2193 => 1.2554, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.1364 => 1.1697, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2292 => 1.2634, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.76% (1.9270 => 1.9802, std. dev.: 0.0105) MultiSource/Applications/Burg/burg: 2.72% (1.1061 => 1.1362, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 2.70% (3.8646 => 3.9690, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.56% (1.3819 => 1.4173, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (7.2180 => 7.3958, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.45% (0.7460 => 0.7643, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4144, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (13.2842 => 13.5908, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (3.6692 => 3.7532, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8698 => 0.8897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.11% (14.8535 => 15.1669, std. dev.: 0.0165) MultiSource/Applications/siod/siod: 2.06% (2.1791 => 2.2239, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.94% (6.5754 => 6.7028, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.3801 => 4.4569, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (4.4433 => 4.5162, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.50% (3.1889 => 3.2368, std. dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.5298 => 14.6966, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.02% (1.8175 => 2.2904, std. dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9699, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.76% (7.4271 => 7.7061, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.22% (4.1080 => 4.1990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.94% (3.6469 => 3.7177, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9529, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6412, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.5627 => 21.0330, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.59% (0.3511 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (20.3410 => 18.6556, std. dev.: 0.0311) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.85% (1.3780 => 1.3249, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5908, std. dev.: 0.0216) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0959, std. dev.: 0.0166) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9787, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8569, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7867, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8523, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2376, std. dev.: 0.0328) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 04:21:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 06:21:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627112115.9C80D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1558?compare_to=1555&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1558, Order: 159258, Start Time: 2012-06-27 10:21:43, End Time: 2012-06-27 11:22:50 To: 1555, Order: 159254, Start Time: 2012-06-27 08:52:24, End Time: 2012-06-27 09:52:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (35 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.17% (18.4402 => 18.6559, std. dev.: 0.0143) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.95% (0.3473 => 0.3749, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3543 => 0.3817, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3543 => 0.3816, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3497 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.68% (0.3516 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3694 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.08% (0.3886 => 0.4161, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3828 => 0.4096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.98% (0.3927 => 0.4201, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.22% (10.3673 => 10.8046, std. dev.: 0.0107) SingleSource/UnitTests/ObjC++/Hello: 3.81% (0.5925 => 0.6151, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.81% (0.6030 => 0.6260, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.59% (10.4361 => 10.8112, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.42% (21.9371 => 22.6863, std. dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.23% (0.4615 => 0.4764, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.99% (0.7433 => 0.7655, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.98% (0.7326 => 0.7544, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.8172 => 0.8414, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.24% (7.0540 => 7.2120, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.89% (7.9617 => 8.1121, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.70% (0.7835 => 0.7968, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.62% (8.1363 => 8.2682, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.9449 => 5.0220, std. dev.: 0.0165) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.49% (4.2646 => 4.3282, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (9.4845 => 9.6239, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.26% (1.5415 => 1.5609, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3734, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.13% (2.0273 => 2.0502, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.11% (5.7591 => 5.8232, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0873, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8176, std. dev.: 0.0177) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6395 => 3.6777, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.49% (0.8651 => 0.7311, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.91% (5.2763 => 4.8061, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (2.9384 => 2.7015, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: -7.90% (22.1758 => 20.4238, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.11% (1.1194 => 1.0510, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5095, std. dev.: 0.0455) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.28% (6.6874 => 6.4010, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.62% (5.3855 => 5.2985, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2373 => 1.1174, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.48% (19.9488 => 18.6559, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9245, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6883, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 05:21:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 07:21:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627122127.E4D222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1559?compare_to=1557&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1559, Order: 159261, Start Time: 2012-06-27 11:26:18, End Time: 2012-06-27 12:23:03 To: 1557, Order: 159256, Start Time: 2012-06-27 10:02:31, End Time: 2012-06-27 10:59:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2706, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5818 => 0.6216, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5748 => 0.6127, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.03% (0.7061 => 0.7487, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3022 => 0.3174, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.95% (0.4062 => 0.4263, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.79% (0.2628 => 0.2754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.75% (0.3578 => 0.3748, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 4.70% (0.3789 => 0.3967, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (3.9660 => 4.1497, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.7710 => 0.8064, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 4.55% (0.3601 => 0.3765, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 4.53% (0.3663 => 0.3829, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.53% (0.3646 => 0.3811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.52% (1.9828 => 2.0725, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.49% (0.3650 => 0.3814, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.47% (0.4003 => 0.4182, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.47% (0.3623 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.45% (0.3914 => 0.4088, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.5265 => 0.5498, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.21% (0.3940 => 0.4106, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.20% (0.3192 => 0.3326, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.86% (13.8202 => 14.3543, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4390 => 0.4544, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.08% (0.4379 => 0.4514, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.4563 => 1.5005, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2562, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 3.00% (16.6129 => 17.1112, std. dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (1.1364 => 1.1700, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.9865 => 5.1320, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.90% (0.5577 => 0.5739, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3755 => 0.3863, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9734, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.81% (1.2292 => 1.2637, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.74% (1.9270 => 1.9798, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.73% (1.1061 => 1.1363, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (7.2180 => 7.3977, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.48% (1.3819 => 1.4162, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4141, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (3.6692 => 3.7537, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5814, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.8698 => 0.8891, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1645, std. dev.: 0.0160) MultiSource/Applications/siod/siod: 2.06% (2.1791 => 2.2239, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.5754 => 6.7064, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (4.3801 => 4.4632, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6135 => 0.6244, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5199, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.50% (3.1889 => 3.2366, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1333 => 1.1493, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.12% (14.5298 => 14.6922, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2698, std. dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 8.27% (1.2998 => 1.4073, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7396, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9698, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.18% (4.1080 => 4.1977, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7084, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9523, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6446, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.68% (22.5627 => 21.0547, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.56% (0.3511 => 0.3351, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.15% (1.2308 => 1.1059, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5695, std. dev.: 0.0194) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5924, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: -2.55% (9.3358 => 9.0979, std. dev.: 0.0172) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9812, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (9.9194 => 9.7867, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8519, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2386, std. dev.: 0.0255) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 05:49:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 07:49:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627124917.54F022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1560?compare_to=1558&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1560, Order: 159261, Start Time: 2012-06-27 11:49:58, End Time: 2012-06-27 12:50:52 To: 1558, Order: 159258, Start Time: 2012-06-27 10:21:43, End Time: 2012-06-27 11:22:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (37 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (822 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.86% (3.7620 => 3.8697, std. dev.: 0.0207) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.95% (0.3473 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3543 => 0.3817, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3543 => 0.3816, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.69% (0.3561 => 0.3835, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3516 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3694 => 0.3968, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.10% (0.3886 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3828 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.95% (0.3927 => 0.4200, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.28% (10.3673 => 10.8112, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 3.86% (0.6030 => 0.6263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5925 => 0.6152, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.55% (10.4361 => 10.8064, std. dev.: 0.0208) SingleSource/UnitTests/ObjC++/property-reference: 3.54% (0.7326 => 0.7585, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.41% (21.9371 => 22.6844, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.08% (0.4615 => 0.4757, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.8172 => 0.8411, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.91% (0.7433 => 0.7649, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (7.0540 => 7.2080, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.74% (0.7835 => 0.7971, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.55% (8.1363 => 8.2628, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (7.9617 => 8.0824, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.45% (4.2646 => 4.3266, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (9.4845 => 9.6208, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (4.9449 => 5.0097, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.24% (5.0018 => 5.0639, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5591, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.10% (2.0273 => 2.0497, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1861 => 1.1992, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.09% (3.3354 => 3.3716, std. dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 1.06% (5.7591 => 5.8202, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.06% (2.0665 => 2.0884, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.57% (26.0924 => 26.7619, std. dev.: 0.0541) MultiSource/Benchmarks/llubenchmark/llu: 2.42% (3.7781 => 3.8697, std. dev.: 0.0207) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (3.6395 => 3.6760, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.30% (0.8651 => 0.7327, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.92% (5.2763 => 4.8055, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.04% (2.9384 => 2.7022, std. dev.: 0.0242) MultiSource/Applications/ClamAV/clamscan: -7.86% (22.1758 => 20.4319, std. dev.: 0.0378) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.31% (1.1194 => 1.0488, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -4.85% (54.1659 => 51.5379, std. dev.: 0.0334) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.28% (6.6874 => 6.4012, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.65% (5.3855 => 5.2966, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (5.3526 => 5.2983, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6202, std. dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9181, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6812, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 05:53:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 07:53:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627125350.492FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1561?compare_to=1556&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1561, Order: 159261, Start Time: 2012-06-27 10:40:01, End Time: 2012-06-27 12:55:24 To: 1556, Order: 159254, Start Time: 2012-06-27 07:57:36, End Time: 2012-06-27 10:13:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (34 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.19% (0.9820 => 0.9937, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3496 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3446 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3460 => 0.3773, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3442 => 0.3752, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3465 => 0.3777, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.00% (0.3488 => 0.3802, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.91% (0.3469 => 0.3778, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.66% (0.3650 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.65% (0.3643 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.40% (0.3724 => 0.4037, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.87% (0.5826 => 0.6110, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.5889 => 0.6153, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.33% (0.7171 => 0.7410, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (1.6211 => 1.6693, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.95% (0.5900 => 0.6074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0673 => 2.1270, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 2.77% (0.9909 => 1.0183, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.76% (3.5627 => 3.6610, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.61% (0.4029 => 0.4134, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.47% (0.9697 => 0.9937, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (0.5026 => 0.5149, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3454, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.22% (0.4994 => 0.5105, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.21% (4.2109 => 4.3038, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.93% (2.7292 => 2.7819, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.81% (23.5202 => 23.9465, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (1.9694 => 2.0039, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (1.9966 => 2.0295, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (2.1013 => 2.1292, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (2.1653 => 2.1931, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.28% (4.4195 => 4.4759, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.23% (4.6177 => 4.6745, std. dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 1.19% (5.5417 => 5.6074, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.61% (2.4764 => 2.3623, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: -2.39% (11.9555 => 11.6699, std. dev.: 0.0041) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 06:45:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 08:45:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627134518.334382A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1562?compare_to=1559&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1562, Order: 159262, Start Time: 2012-06-27 12:50:11, End Time: 2012-06-27 13:46:53 To: 1559, Order: 159261, Start Time: 2012-06-27 11:26:18, End Time: 2012-06-27 12:23:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.41% (0.4038 => 0.4297, std. dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2722, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 6.86% (0.5818 => 0.6217, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.61% (0.5748 => 0.6128, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7061 => 0.7488, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.99% (1.3693 => 1.4376, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 4.81% (0.3578 => 0.3750, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1505, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.64% (0.2696 => 0.2821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.64% (0.3646 => 0.3815, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 4.62% (0.3789 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.61% (0.3623 => 0.3790, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.58% (0.3601 => 0.3766, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (1.9828 => 2.0728, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2760 => 0.2885, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 4.50% (0.3663 => 0.3828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.47% (0.4003 => 0.4182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.47% (0.3914 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.44% (0.3650 => 0.3812, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.42% (0.3940 => 0.4114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.31% (0.5265 => 0.5492, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.01% (0.6959 => 0.7238, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 3.95% (0.2988 => 0.3106, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.93% (0.3534 => 0.3673, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.83% (13.8202 => 14.3492, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4390 => 0.4551, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.06% (0.7506 => 0.7736, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4379 => 0.4511, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.01% (0.5577 => 0.5745, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.4563 => 1.4998, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.3245 => 1.3637, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1041, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1318, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (1.1364 => 1.1688, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.84% (1.2292 => 1.2641, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 2.81% (1.1061 => 1.1372, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.79% (1.9270 => 1.9807, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (3.8646 => 3.9713, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (1.3813 => 1.4168, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (7.2180 => 7.4000, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (1.3819 => 1.4150, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.31% (3.6692 => 3.7541, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (0.7460 => 0.7632, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.8698 => 0.8892, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5772, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1625, std. dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (6.5754 => 6.7110, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2237, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4665, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (4.4433 => 4.5201, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.54% (3.1889 => 3.2381, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.17% (14.5298 => 14.7000, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.52% (1.8175 => 2.2995, std. dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.64% (1.2998 => 1.3861, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7264, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9230, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.17% (4.1080 => 4.1972, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6469 => 3.7105, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6407, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.73% (0.4657 => 0.4297, std. dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0374, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3511 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.39% (0.9108 => 0.8981, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (20.3410 => 18.6583, std. dev.: 0.0525) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5906, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1007, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9793, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2613, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4884, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7872, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8530, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2459, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 07:17:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 09:17:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627141714.BDBD32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1563?compare_to=1560&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1563, Order: 159262, Start Time: 2012-06-27 13:18:00, End Time: 2012-06-27 14:18:51 To: 1560, Order: 159261, Start Time: 2012-06-27 11:49:58, End Time: 2012-06-27 12:50:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (820 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.35% (0.3543 => 0.3839, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.00% (0.3473 => 0.3751, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3543 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3516 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.61% (0.3561 => 0.3832, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.39% (0.3694 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.08% (0.3927 => 0.4205, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.05% (0.3886 => 0.4160, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3828 => 0.4097, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.22% (10.3673 => 10.8052, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 3.83% (0.6030 => 0.6261, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.75% (0.5925 => 0.6147, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (10.4361 => 10.8080, std. dev.: 0.0150) MultiSource/Applications/JM/lencod/lencod: 3.39% (21.9371 => 22.6815, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.10% (0.4615 => 0.4758, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.04% (0.7326 => 0.7549, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.97% (0.7433 => 0.7654, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.09% (7.0540 => 7.2016, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5860 => 0.5978, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.76% (0.7835 => 0.7973, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (8.1363 => 8.2618, std. dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.50% (7.9617 => 8.0812, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.2646 => 4.3269, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (4.9449 => 5.0120, std. dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 1.34% (9.4845 => 9.6116, std. dev.: 0.0142) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.31% (5.0018 => 5.0673, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.30% (1.5415 => 1.5616, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.22% (3.3354 => 3.3760, std. dev.: 0.0102) MultiSource/Applications/treecc/treecc: 1.18% (2.0273 => 2.0513, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 1.12% (5.7591 => 5.8238, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2265, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.07% (1.1642 => 1.1766, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1861 => 1.1983, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0665 => 2.0877, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.61% (26.0924 => 26.7747, std. dev.: 0.0467) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6395 => 3.6783, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.48% (0.8651 => 0.7312, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.92% (5.2763 => 4.8058, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (2.9384 => 2.7024, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -7.87% (22.1758 => 20.4310, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.32% (1.1194 => 1.0486, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5439, std. dev.: 0.0326) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (6.6874 => 6.3966, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.64% (5.3855 => 5.2972, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (5.3526 => 5.2962, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2373 => 1.1153, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5171, std. dev.: 0.0551) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9162, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6844, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 08:36:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 10:36:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627153605.D30D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1564?compare_to=1561&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1564, Order: 159262, Start Time: 2012-06-27 13:22:21, End Time: 2012-06-27 15:37:42 To: 1561, Order: 159261, Start Time: 2012-06-27 10:40:01, End Time: 2012-06-27 12:55:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3460 => 0.3776, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.04% (0.3496 => 0.3812, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.02% (0.3446 => 0.3757, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3465 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3442 => 0.3751, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.97% (0.3488 => 0.3801, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/synchronized: 8.88% (0.3469 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.73% (0.3643 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.66% (0.3650 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.3724 => 0.4042, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.81% (0.5826 => 0.6106, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.35% (0.5889 => 0.6145, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.39% (0.7171 => 0.7414, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.5900 => 0.6077, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (1.6211 => 1.6692, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (2.0673 => 2.1261, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.80% (3.5627 => 3.6623, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (0.5026 => 0.5164, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.72% (0.9909 => 1.0179, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.68% (0.3726 => 0.3826, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.56% (0.9697 => 0.9945, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (1.3152 => 1.3453, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.27% (4.2109 => 4.3065, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (0.4994 => 0.5097, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.90% (2.7292 => 2.7810, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (1.9694 => 2.0035, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 1.69% (23.5202 => 23.9170, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (1.9966 => 2.0293, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.49% (1.0781 => 1.0942, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (2.1653 => 2.1936, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (2.1013 => 2.1279, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (4.4195 => 4.4750, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.15% (4.6177 => 4.6708, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 1.13% (1.8794 => 1.9006, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.12% (5.5417 => 5.6037, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.45% (11.9555 => 11.6631, std. dev.: 0.0044) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 08:52:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 10:52:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627155230.5E6362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1565?compare_to=1562&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1565, Order: 159265, Start Time: 2012-06-27 14:57:19, End Time: 2012-06-27 15:54:05 To: 1562, Order: 159262, Start Time: 2012-06-27 12:50:11, End Time: 2012-06-27 13:46:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.28% (1.3861 => 1.4177, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.49% (3.8322 => 3.7752, std. dev.: 0.0171) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.29% (2.0176 => 2.2656, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.68% (0.5748 => 0.6132, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.09% (0.7061 => 0.7491, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7038 => 0.7396, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.05% (1.3693 => 1.4385, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.7710 => 0.8094, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 4.95% (0.3578 => 0.3755, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.88% (0.3646 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.86% (0.3601 => 0.3776, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.75% (0.3789 => 0.3969, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0764, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 4.70% (0.3663 => 0.3835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 4.66% (0.3623 => 0.3792, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1504, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 4.62% (0.4003 => 0.4188, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.60% (0.3650 => 0.3818, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.2988 => 0.3121, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.5265 => 0.5498, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 4.42% (0.3940 => 0.4114, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.6959 => 0.7232, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.74% (13.8202 => 14.3376, std. dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4390 => 0.4547, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9199 => 0.9521, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.2193 => 1.2568, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.4563 => 1.5010, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 3.01% (16.6129 => 17.1127, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3245 => 1.3632, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2292 => 1.2645, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.87% (0.5577 => 0.5737, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8646 => 3.9752, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1364 => 1.1689, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.78% (0.7506 => 0.7715, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.76% (1.9270 => 1.9802, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.76% (1.1061 => 1.1366, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.9865 => 5.1175, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4172, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.49% (1.3813 => 1.4157, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (7.2180 => 7.3975, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (3.6692 => 3.7531, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.8698 => 0.8886, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (13.2842 => 13.5705, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 2.11% (14.8535 => 15.1665, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 2.08% (2.1791 => 2.2244, std. dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7010, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.3801 => 4.4592, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5180, std. dev.: 0.0117) MultiSource/Applications/d/make_dparser: 1.57% (3.1889 => 3.2390, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6909, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: 9.07% (1.2998 => 1.4177, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7317, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (2.8606 => 2.9700, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.76% (12.4560 => 12.9246, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.15% (4.1080 => 4.1964, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5089 => 1.5371, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7082, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5075, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6423, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0518, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3511 => 0.3349, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (20.3410 => 18.6314, std. dev.: 0.0328) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1006, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.49% (0.4867 => 0.4746, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6070, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2542, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9816, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7871, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8520, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2510, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 08:56:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 10:56:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627155658.1C9022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1566?compare_to=1563&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1566, Order: 159265, Start Time: 2012-06-27 14:57:40, End Time: 2012-06-27 15:58:33 To: 1563, Order: 159262, Start Time: 2012-06-27 13:18:00, End Time: 2012-06-27 14:18:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (40 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (820 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (10.8052 => 10.9729, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.52% (0.3497 => 0.3760, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3543 => 0.3808, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.45% (0.3516 => 0.3778, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.45% (0.3543 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3694 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.03% (0.3886 => 0.4159, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.88% (0.3927 => 0.4197, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3828 => 0.4090, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 5.84% (10.3673 => 10.9729, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (10.4361 => 10.8147, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 3.55% (21.9371 => 22.7169, std. dev.: 0.0264) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5925 => 0.6133, std. dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.6030 => 0.6236, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.93% (0.7433 => 0.7651, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.59% (0.7326 => 0.7516, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (7.0540 => 7.2313, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.8172 => 0.8367, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.85% (0.7835 => 0.7980, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.74% (7.9617 => 8.1003, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.70% (8.1363 => 8.2748, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.64% (4.2646 => 4.3347, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (9.4845 => 9.6247, std. dev.: 0.0211) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (5.0018 => 5.0745, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.41% (0.8067 => 0.8181, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0132, std. dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 1.30% (5.7591 => 5.8342, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.22% (1.1642 => 1.1784, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3734, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 1.12% (2.0273 => 2.0501, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (2.2024 => 2.2271, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.08% (1.5415 => 1.5581, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.06% (3.8723 => 3.9135, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1861 => 1.1987, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.05% (2.2022 => 2.2254, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8250, std. dev.: 0.0263) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.51% (0.8651 => 0.7309, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.01% (5.2763 => 4.8007, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.21% (2.9384 => 2.6972, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.72% (22.1758 => 20.4634, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.42% (1.1194 => 1.0475, std. dev.: 0.0162) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4726, std. dev.: 0.0859) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.51% (6.6874 => 6.3858, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.39% (5.3855 => 5.3108, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5535, std. dev.: 0.0631) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9156, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 10:38:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 12:38:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627173834.69B422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1567?compare_to=1565&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1567, Order: 159267, Start Time: 2012-06-27 16:43:27, End Time: 2012-06-27 17:40:09 To: 1565, Order: 159265, Start Time: 2012-06-27 14:57:19, End Time: 2012-06-27 15:54:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2679, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5818 => 0.6216, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5748 => 0.6136, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.22% (0.7061 => 0.7500, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4328 => 0.4572, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.7710 => 0.8111, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.08% (1.3693 => 1.4389, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.94% (0.3485 => 0.3657, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 4.89% (0.3578 => 0.3753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3899 => 0.4089, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 4.78% (0.3601 => 0.3773, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.75% (0.3623 => 0.3795, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.74% (0.3646 => 0.3819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0764, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.72% (0.2966 => 0.3106, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.70% (0.3789 => 0.3967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/synchronized: 4.67% (0.3663 => 0.3834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 4.65% (0.4003 => 0.4189, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1502, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.63% (0.3650 => 0.3819, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.48% (0.5265 => 0.5501, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 4.39% (0.3940 => 0.4113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3580 => 0.3736, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.87% (0.4390 => 0.4560, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3756 => 0.3898, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.76% (13.8202 => 14.3403, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9199 => 0.9521, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 3.18% (1.9270 => 1.9883, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.4563 => 1.5011, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4379 => 0.4513, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.05% (16.6129 => 17.1189, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3631, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.85% (0.7506 => 0.7720, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.84% (1.2292 => 1.2641, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (3.8646 => 3.9739, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 2.80% (1.1061 => 1.1371, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (4.9865 => 5.1220, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (1.3819 => 1.4187, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.7460 => 0.7651, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4152, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (7.2180 => 7.3919, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.8698 => 0.8895, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (3.6692 => 3.7520, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5762, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.10% (14.8535 => 15.1652, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2243, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7010, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.78% (4.3801 => 4.4581, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5180, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.49% (3.1889 => 3.2363, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.09% (14.5298 => 14.6886, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.11% (1.8175 => 2.2921, std. dev.: 0.0342) SingleSource/Benchmarks/Misc/mandel-2: 9.09% (1.2998 => 1.4180, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.25% (2.0200 => 2.1866, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7234, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.80% (2.8606 => 2.9692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9220, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.18% (4.1080 => 4.1977, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6469 => 3.7160, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9531, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6420, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0521, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.96% (0.3511 => 0.3372, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.54% (0.9108 => 0.8968, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5560, std. dev.: 0.0673) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -2.73% (9.3358 => 9.0810, std. dev.: 0.0237) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5864, std. dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.33% (9.9194 => 9.7873, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8522, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2457, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 10:42:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 12:42:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627174245.8CD282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1568?compare_to=1566&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1568, Order: 159267, Start Time: 2012-06-27 16:43:39, End Time: 2012-06-27 17:44:20 To: 1566, Order: 159265, Start Time: 2012-06-27 14:57:40, End Time: 2012-06-27 15:58:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3473 => 0.3738, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3497 => 0.3757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3516 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3543 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.41% (0.3561 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3694 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.97% (0.3886 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.85% (0.3927 => 0.4196, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3828 => 0.4089, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.87% (10.3673 => 10.9754, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (10.4361 => 10.8124, std. dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 3.50% (21.9371 => 22.7055, std. dev.: 0.0274) SingleSource/UnitTests/ObjC++/Hello: 3.48% (0.5925 => 0.6131, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.7433 => 0.7650, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (7.0540 => 7.2421, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.57% (0.7326 => 0.7514, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4615 => 0.4721, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.85% (0.7835 => 0.7980, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.66% (7.9617 => 8.0938, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.65% (8.1363 => 8.2704, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.59% (4.2646 => 4.3324, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (9.4845 => 9.6296, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.9449 => 5.0137, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 1.34% (5.7591 => 5.8363, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.33% (5.0018 => 5.0682, std. dev.: 0.0186) MultiSource/Applications/treecc/treecc: 1.29% (2.0273 => 2.0534, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.23% (3.8723 => 3.9200, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1861 => 1.1992, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.76% (26.0924 => 26.8129, std. dev.: 0.0361) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6395 => 3.6772, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.52% (0.8651 => 0.7308, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.02% (5.2763 => 4.8006, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.21% (2.9384 => 2.6973, std. dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: -7.78% (22.1758 => 20.4502, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (1.1194 => 1.0478, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -4.89% (54.1659 => 51.5184, std. dev.: 0.0574) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.45% (6.6874 => 6.3899, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.43% (5.3855 => 5.3087, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2373 => 1.1044, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.09% (19.9488 => 18.5344, std. dev.: 0.1057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9252, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6872, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 11:18:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 13:18:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627181832.26ECD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1569?compare_to=1564&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1569, Order: 159265, Start Time: 2012-06-27 16:04:48, End Time: 2012-06-27 18:20:08 To: 1564, Order: 159262, Start Time: 2012-06-27 13:22:21, End Time: 2012-06-27 15:37:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3496 => 0.3805, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3460 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.59% (0.3446 => 0.3742, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.57% (0.3488 => 0.3787, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.57% (0.3465 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.54% (0.3442 => 0.3736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.42% (0.3469 => 0.3761, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.36% (0.3650 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.21% (0.3643 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.98% (0.3724 => 0.4021, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 4.70% (0.5826 => 0.6100, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.31% (0.5889 => 0.6143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7171 => 0.7394, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (1.6211 => 1.6676, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (0.5026 => 0.5166, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (3.5627 => 3.6563, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (2.0673 => 2.1206, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 2.55% (0.9909 => 1.0162, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.5900 => 0.6044, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.24% (1.3152 => 1.3447, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.16% (4.2109 => 4.3017, std. dev.: 0.0081) MultiSource/Applications/hbd/hbd: 2.09% (0.9697 => 0.9900, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.82% (2.7292 => 2.7790, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.77% (23.5202 => 23.9355, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (1.9694 => 2.0001, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (1.9966 => 2.0256, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.37% (1.0781 => 1.0929, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (2.1653 => 2.1938, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (4.4195 => 4.4751, std. dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (2.1013 => 2.1265, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 1.13% (4.6177 => 4.6700, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 1.11% (5.5417 => 5.6032, std. dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (1.8794 => 1.8989, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.8036 => 2.8327, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.54% (2.4764 => 2.3639, std. dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -2.39% (11.9555 => 11.6702, std. dev.: 0.0197) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 12:02:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 14:02:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627190218.AF9EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1570?compare_to=1567&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1570, Order: 159272, Start Time: 2012-06-27 18:07:14, End Time: 2012-06-27 19:03:54 To: 1567, Order: 159267, Start Time: 2012-06-27 16:43:27, End Time: 2012-06-27 17:40:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -1.14% (8.6688 => 8.5702, std. dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.74% (2.0176 => 2.2746, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 6.29% (0.5818 => 0.6184, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5748 => 0.6098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7061 => 0.7451, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.7710 => 0.8110, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4328 => 0.4552, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7038 => 0.7394, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.89% (1.3693 => 1.4363, std. dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4062 => 0.4256, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.54% (3.9660 => 4.1459, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.43% (0.3022 => 0.3156, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.33% (0.3789 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.30% (0.3601 => 0.3756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.29% (0.2655 => 0.2769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.26% (0.3663 => 0.3819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.25% (0.3646 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.21% (0.3899 => 0.4063, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.20% (0.3623 => 0.3775, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.19% (0.3650 => 0.3803, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.2966 => 0.3090, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.17% (1.9828 => 2.0655, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2628 => 0.2737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.12% (0.2696 => 0.2807, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 4.11% (0.3940 => 0.4102, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3149 => 0.3276, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3107 => 0.3232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2761 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4016 => 0.4167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3192 => 0.3312, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3246, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (0.3756 => 0.3886, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.45% (0.9199 => 0.9516, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3868 => 0.3994, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4993, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3631, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.87% (1.1364 => 1.1690, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.85% (16.6129 => 17.0864, std. dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (3.8646 => 3.9732, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5577 => 0.5732, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.74% (0.7506 => 0.7712, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.73% (4.9865 => 5.1225, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.68% (1.9270 => 1.9787, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.65% (1.1061 => 1.1354, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3813 => 1.4175, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.53% (1.3819 => 1.4168, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.45% (1.2292 => 1.2593, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (3.6692 => 3.7562, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8310 => 0.8504, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (7.2180 => 7.3842, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5795, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1621, std. dev.: 0.0127) MultiSource/Applications/siod/siod: 1.99% (2.1791 => 2.2225, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8698 => 0.8871, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.98% (6.5754 => 6.7054, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.3801 => 4.4547, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (4.4433 => 4.5162, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.40% (3.1889 => 3.2336, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.1333 => 1.1485, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.10% (14.5298 => 14.6891, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.08% (0.1824 => 0.3540, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.56% (1.8175 => 2.2821, std. dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7248, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6999, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1938, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6424, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.89% (22.5627 => 21.0082, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3511 => 0.3353, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2308 => 1.1017, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (20.3410 => 18.5926, std. dev.: 0.0369) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.72% (9.3358 => 9.0818, std. dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5895, std. dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.52% (3.0263 => 2.9803, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2602, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8530, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2546, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 12:10:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 14:10:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627191055.0D1ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1571?compare_to=1568&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1571, Order: 159272, Start Time: 2012-06-27 18:11:43, End Time: 2012-06-27 19:12:30 To: 1568, Order: 159267, Start Time: 2012-06-27 16:43:39, End Time: 2012-06-27 17:44:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (31 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.01% (1.1044 => 1.1156, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.09% (10.9754 => 10.6365, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.09% (0.3473 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.82% (0.3543 => 0.3820, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 7.81% (0.3497 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3543 => 0.3819, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3561 => 0.3838, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 7.74% (0.3516 => 0.3788, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.53% (0.3694 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3828 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.13% (0.3886 => 0.4163, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.05% (0.3927 => 0.4204, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.4361 => 10.8609, std. dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference-object: 3.48% (0.6030 => 0.6240, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.41% (0.5925 => 0.6127, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.24% (21.9371 => 22.6475, std. dev.: 0.0342) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7326 => 0.7525, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7433 => 0.7627, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.60% (10.3673 => 10.6365, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4615 => 0.4726, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.16% (7.0540 => 7.2061, std. dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (7.9617 => 8.0831, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2529, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.9449 => 5.0135, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (4.2646 => 4.3158, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (5.0018 => 5.0605, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.03% (1.5415 => 1.5574, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (9.4845 => 9.5814, std. dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 1.01% (5.7591 => 5.8171, std. dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.8008, std. dev.: 0.0431) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.19% (3.6395 => 3.6829, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.42% (0.8651 => 0.7317, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.10% (5.2763 => 4.7959, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.08% (2.9384 => 2.7011, std. dev.: 0.0247) MultiSource/Applications/ClamAV/clamscan: -8.00% (22.1758 => 20.4025, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.30% (1.1194 => 1.0489, std. dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4982, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.34% (6.6874 => 6.3969, std. dev.: 0.0267) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.52% (5.3855 => 5.3039, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1156, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.16% (19.9488 => 18.5213, std. dev.: 0.0651) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (8.1563 => 7.9320, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6861, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 13:26:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 15:26:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627202607.546A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1572?compare_to=1570&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1572, Order: 159280, Start Time: 2012-06-27 19:30:59, End Time: 2012-06-27 20:27:42 To: 1570, Order: 159272, Start Time: 2012-06-27 18:07:14, End Time: 2012-06-27 19:03:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2758, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 6.77% (0.5818 => 0.6212, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5748 => 0.6122, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.82% (0.7061 => 0.7472, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 4.91% (1.3693 => 1.4365, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (3.9660 => 4.1447, std. dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.45% (0.2765 => 0.2888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (0.2655 => 0.2772, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 4.36% (0.3578 => 0.3734, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.33% (0.2607 => 0.2720, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.24% (1.9828 => 2.0669, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 4.20% (0.3789 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.19% (0.3601 => 0.3752, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.2937 => 0.3060, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.17% (0.2760 => 0.2875, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.15% (0.3899 => 0.4061, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2628 => 0.2737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.11% (0.3646 => 0.3796, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.07% (0.4003 => 0.4166, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 4.07% (0.3663 => 0.3812, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.05% (0.3650 => 0.3798, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.04% (0.2696 => 0.2805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.04% (0.3940 => 0.4099, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3107 => 0.3231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.99% (0.3914 => 0.4070, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.95% (0.3623 => 0.3766, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3580 => 0.3720, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.82% (0.3192 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3293 => 0.3413, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.58% (13.8202 => 14.3156, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.33% (0.3756 => 0.3881, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3868 => 0.3991, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (1.4563 => 1.4991, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.90% (0.5577 => 0.5739, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.81% (0.7506 => 0.7717, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4194, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.71% (16.6129 => 17.0631, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.69% (1.3813 => 1.4184, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1160, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.58% (1.1061 => 1.1346, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.54% (1.9270 => 1.9759, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.50% (1.2292 => 1.2599, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (3.6692 => 3.7522, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (13.2842 => 13.5540, std. dev.: 0.0156) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.98% (14.8535 => 15.1471, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.5754 => 6.6998, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.8698 => 0.8860, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.3801 => 4.4509, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.4433 => 4.5116, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.38% (3.1889 => 3.2328, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6978, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 6.92% (1.2998 => 1.3897, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7336, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7053, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9290 => 1.9507, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.94% (22.5627 => 20.9964, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3511 => 0.3373, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.88% (0.8818 => 0.8564, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2102, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5550, std. dev.: 0.0422) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -2.57% (9.3358 => 9.0959, std. dev.: 0.0352) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6047, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.07% (6.6320 => 6.4944, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2485, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2118, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.60% (3.9173 => 3.8545, std. dev.: 0.0095) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9821, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.30% (28.2225 => 27.8562, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2480, std. dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 13:38:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 15:38:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627203845.A45562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1573?compare_to=1571&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1573, Order: 159280, Start Time: 2012-06-27 19:39:38, End Time: 2012-06-27 20:40:21 To: 1571, Order: 159272, Start Time: 2012-06-27 18:11:43, End Time: 2012-06-27 19:12:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (30 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (829 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.21% (0.3473 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.02% (0.3543 => 0.3827, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.85% (0.3543 => 0.3821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.69% (0.3561 => 0.3835, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3694 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3828 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.13% (0.3886 => 0.4163, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.03% (0.3927 => 0.4203, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8587, std. dev.: 0.0146) SingleSource/UnitTests/ObjC++/Hello: 3.88% (0.5925 => 0.6155, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.83% (0.6030 => 0.6261, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.23% (21.9371 => 22.6456, std. dev.: 0.0242) SingleSource/UnitTests/ObjC++/property-reference: 3.06% (0.7326 => 0.7550, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (0.7433 => 0.7623, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (10.3673 => 10.6258, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (7.0540 => 7.2102, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.8172 => 0.8350, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.46% (8.1363 => 8.2551, std. dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.37% (7.9617 => 8.0711, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.9449 => 5.0072, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (4.2646 => 4.3158, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (5.0018 => 5.0564, std. dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (9.4845 => 9.5866, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.06% (5.7591 => 5.8201, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8261, std. dev.: 0.0219) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6395 => 3.6783, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.07% (0.8651 => 0.7261, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.29% (5.2763 => 4.7863, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.25% (2.9384 => 2.6961, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -7.91% (22.1758 => 20.4210, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.31% (1.1194 => 1.0488, std. dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4369, std. dev.: 0.0359) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.32% (6.6874 => 6.3987, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (5.3855 => 5.2929, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.02% (5.3526 => 5.2980, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2373 => 1.1162, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.53% (19.9488 => 18.6471, std. dev.: 0.0408) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9214, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6766, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 14:00:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 16:00:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627210056.7A0862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1574?compare_to=1569&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1574, Order: 159279, Start Time: 2012-06-27 18:47:07, End Time: 2012-06-27 21:02:32 To: 1569, Order: 159265, Start Time: 2012-06-27 16:04:48, End Time: 2012-06-27 18:20:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (36 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 10.28% (0.2178 => 0.2402, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.55% (0.3488 => 0.3821, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3496 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.46% (0.3446 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.44% (0.3465 => 0.3792, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3460 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3442 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3469 => 0.3792, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.98% (0.3643 => 0.3970, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 8.96% (0.3650 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.75% (0.3724 => 0.4050, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.17% (0.5826 => 0.6127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.87% (0.5889 => 0.6176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.27% (0.7171 => 0.7477, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (1.6211 => 1.6705, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (3.5627 => 3.6666, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (0.5026 => 0.5165, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (2.0673 => 2.1238, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.5900 => 0.6058, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.65% (0.9909 => 1.0172, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.56% (0.4029 => 0.4132, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (1.3152 => 1.3471, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 2.30% (4.2109 => 4.3076, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 2.10% (23.5202 => 24.0153, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (0.4994 => 0.5096, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.7292 => 2.7833, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (1.9694 => 2.0043, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.70% (0.9697 => 0.9862, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (1.9966 => 2.0281, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.58% (1.0781 => 1.0951, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 1.42% (5.5417 => 5.6204, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (4.4195 => 4.4791, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.30% (2.1653 => 2.1935, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.25% (4.6177 => 4.6754, std. dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 1.18% (1.8794 => 1.9016, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (2.1013 => 2.1259, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.48% (2.4764 => 2.3655, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -2.26% (11.9555 => 11.6853, std. dev.: 0.0049) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 14:49:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 16:49:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627214945.B26792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1575?compare_to=1572&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1575, Order: 159282, Start Time: 2012-06-27 20:54:45, End Time: 2012-06-27 21:51:20 To: 1572, Order: 159280, Start Time: 2012-06-27 19:30:59, End Time: 2012-06-27 20:27:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2761, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.5818 => 0.6201, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5748 => 0.6113, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7061 => 0.7471, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7038 => 0.7396, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.95% (1.3693 => 1.4371, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2781 => 0.2917, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.7710 => 0.8076, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.63% (0.3022 => 0.3162, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (3.9660 => 4.1454, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2690 => 0.2811, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2765 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.33% (0.3899 => 0.4068, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.10% (1.9828 => 2.0641, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.01% (0.2966 => 0.3085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.6959 => 0.7232, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2761 => 0.2869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.81% (0.3646 => 0.3785, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3192 => 0.3312, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.75% (0.3789 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.74% (0.3663 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.72% (0.3601 => 0.3735, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.3580 => 0.3713, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.70% (13.8202 => 14.3318, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-3: 3.64% (0.3623 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.62% (0.4003 => 0.4148, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.60% (0.3914 => 0.4055, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.59% (0.3650 => 0.3781, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.55% (0.3940 => 0.4080, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.55% (1.3819 => 1.4309, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9199 => 0.9521, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (0.3756 => 0.3886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3534 => 0.3656, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.4390 => 0.4536, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3868 => 0.3991, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.15% (1.3813 => 1.4248, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5015, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.09% (0.5637 => 0.5811, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2193 => 1.2561, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1693, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4379 => 0.4505, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.86% (0.7506 => 0.7721, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5577 => 0.5735, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9715, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 2.64% (1.9270 => 1.9778, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1149, std. dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 2.52% (16.6129 => 17.0314, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2292 => 1.2591, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (7.2180 => 7.3925, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.7460 => 0.7640, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.25% (3.6692 => 3.7517, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5824, std. dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 2.05% (14.8535 => 15.1583, std. dev.: 0.0151) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2230, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.5754 => 6.6998, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.8698 => 0.8857, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.3801 => 4.4522, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.4433 => 4.5125, std. dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.38% (3.1889 => 3.2328, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.5298 => 14.6872, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.30% (0.1824 => 0.3544, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2659, std. dev.: 0.0506) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4020, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7224, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6469 => 3.7112, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6410, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.5627 => 20.9815, std. dev.: 0.0263) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3511 => 0.3353, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.60% (0.8818 => 0.8589, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2083, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1111, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.12% (20.3410 => 18.4853, std. dev.: 0.0641) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0113) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5802, std. dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.35% (9.3358 => 9.1160, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5135, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9784, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8532, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.09% (7.3305 => 7.2505, std. dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 15:06:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 17:06:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627220649.BF7032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1576?compare_to=1573&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1576, Order: 159292, Start Time: 2012-06-27 21:07:35, End Time: 2012-06-27 22:08:25 To: 1573, Order: 159280, Start Time: 2012-06-27 19:39:38, End Time: 2012-06-27 20:40:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (32 on baseline) Performance Improvements: 0 (14 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (827 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.26% (0.3473 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3497 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.99% (0.3543 => 0.3826, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.95% (0.3561 => 0.3844, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.69% (0.3694 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3828 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.23% (0.3927 => 0.4211, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9267, std. dev.: 0.0169) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5925 => 0.6148, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 3.62% (0.6030 => 0.6248, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.40% (21.9371 => 22.6834, std. dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4615 => 0.4751, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.8172 => 0.8384, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (7.0540 => 7.2189, std. dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 1.93% (10.3673 => 10.5675, std. dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (7.9617 => 8.0821, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.51% (8.1363 => 8.2590, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (9.4845 => 9.6109, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (4.9449 => 5.0105, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (2.2022 => 2.2300, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (4.2646 => 4.3159, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (5.0018 => 5.0604, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.12% (5.7591 => 5.8238, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7834, std. dev.: 0.0274) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (1.5086 => 1.5394, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.10% (0.8651 => 0.7258, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.11% (5.2763 => 4.7957, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.21% (2.9384 => 2.6971, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -7.86% (22.1758 => 20.4331, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (1.1194 => 1.0473, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4669, std. dev.: 0.0362) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.39% (6.6874 => 6.3938, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.64% (5.3855 => 5.2970, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.04% (5.3526 => 5.2972, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2373 => 1.1079, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5675, std. dev.: 0.0409) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9209, std. dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6846, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 16:13:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 18:13:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120627231335.E27042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1577?compare_to=1575&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1577, Order: 159295, Start Time: 2012-06-27 22:18:31, End Time: 2012-06-27 23:15:11 To: 1575, Order: 159282, Start Time: 2012-06-27 20:54:45, End Time: 2012-06-27 21:51:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2766, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.81% (0.5818 => 0.6214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5748 => 0.6126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7061 => 0.7485, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4328 => 0.4562, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.89% (1.3693 => 1.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.72% (0.2966 => 0.3106, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.63% (0.2765 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.53% (0.2761 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.50% (3.9660 => 4.1443, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.9828 => 2.0711, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3489 => 0.3640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5265 => 0.5485, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 4.14% (0.3578 => 0.3726, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.86% (0.3601 => 0.3740, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.85% (0.3789 => 0.3935, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 3.84% (0.3646 => 0.3786, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.81% (0.3650 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.81% (0.3914 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.80% (0.4003 => 0.4155, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 3.78% (0.3623 => 0.3760, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 3.74% (0.3663 => 0.3800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.60% (13.8202 => 14.3179, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 3.53% (0.3940 => 0.4079, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.50% (1.3819 => 1.4302, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5637 => 0.5807, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4379 => 0.4505, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2292 => 1.2617, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0498, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.9865 => 5.1174, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9656, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.56% (1.3813 => 1.4166, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.53% (1.9270 => 1.9758, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 2.53% (0.7506 => 0.7696, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.28% (0.7460 => 0.7630, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (7.2180 => 7.3769, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.16% (3.6692 => 3.7484, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (13.2842 => 13.5708, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.8698 => 0.8880, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1639, std. dev.: 0.0067) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2195, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.5754 => 6.6955, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.3801 => 4.4508, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.4433 => 4.5117, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0411) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.96% (1.2998 => 1.3903, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7278, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6807, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7088, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5089 => 1.5326, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6444, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std. dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0046, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3511 => 0.3352, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (6.2785 => 6.2012, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.90% (20.3410 => 18.5300, std. dev.: 0.0741) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5793, std. dev.: 0.0210) MultiSource/Applications/minisat/minisat: -2.65% (9.3358 => 9.0884, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5146, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2587, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9814, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8515, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 16:34:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 18:34:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120627233459.66EB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1578?compare_to=1576&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1578, Order: 159296, Start Time: 2012-06-27 22:35:40, End Time: 2012-06-27 23:36:35 To: 1576, Order: 159292, Start Time: 2012-06-27 21:07:35, End Time: 2012-06-27 22:08:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (35 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.57% (3.7887 => 3.8483, std. dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3473 => 0.3771, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 8.38% (0.3497 => 0.3790, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.35% (0.3543 => 0.3839, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.30% (0.3543 => 0.3837, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3694 => 0.3990, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.69% (0.3886 => 0.4185, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.68% (0.3828 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.3927 => 0.4223, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (10.4361 => 10.9093, std. dev.: 0.0233) SingleSource/UnitTests/ObjC++/Hello: 4.08% (0.5925 => 0.6167, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 4.03% (0.6030 => 0.6273, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 3.31% (21.9371 => 22.6632, std. dev.: 0.0415) SingleSource/UnitTests/ObjC++/property-reference: 3.25% (0.7326 => 0.7564, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7433 => 0.7627, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.28% (7.0540 => 7.2145, std. dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (10.3673 => 10.5596, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.8172 => 0.8318, std. dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.73% (7.9617 => 8.0997, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.71% (0.7835 => 0.7969, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (8.1363 => 8.2636, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (4.9449 => 5.0122, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.28% (9.4845 => 9.6058, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (5.0018 => 5.0651, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2646 => 4.3139, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (2.2022 => 2.2271, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.13% (5.7591 => 5.8242, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.11% (2.0665 => 2.0894, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8639, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.99% (1.5086 => 1.5386, std. dev.: 0.0099) MultiSource/Benchmarks/llubenchmark/llu: 1.86% (3.7781 => 3.8483, std. dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.30% (3.6395 => 3.6867, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.41% (0.8651 => 0.7318, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.93% (5.2763 => 4.8053, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -8.02% (22.1758 => 20.3968, std. dev.: 0.0303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.02% (2.9384 => 2.7027, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (1.1194 => 1.0511, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4609, std. dev.: 0.0329) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.24% (6.6874 => 6.4038, std. dev.: 0.0396) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.48% (5.3855 => 5.3060, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.28% (19.9488 => 18.4957, std. dev.: 0.0721) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9227, std. dev.: 0.0181) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6828, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 16:43:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 18:43:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120627234308.997342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1579?compare_to=1574&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1579, Order: 159293, Start Time: 2012-06-27 21:29:26, End Time: 2012-06-27 23:44:44 To: 1574, Order: 159279, Start Time: 2012-06-27 18:47:07, End Time: 2012-06-27 21:02:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (29 on baseline) Performance Improvements: 2 (2 on baseline) Unchanged Tests: 892 (863 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.72% (0.4021 => 0.3791, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: -1.65% (0.7477 => 0.7354, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3488 => 0.3818, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.73% (0.3446 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3465 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.70% (0.3460 => 0.3761, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.70% (0.3496 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3442 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.56% (0.3469 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.40% (0.3643 => 0.3949, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 8.27% (0.3650 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.08% (0.3724 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.71% (0.5826 => 0.6042, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.38% (0.5889 => 0.6088, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (0.5026 => 0.5181, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (1.6211 => 1.6658, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7171 => 0.7354, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (2.0673 => 2.1191, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (3.5627 => 3.6498, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3454, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.26% (0.9909 => 1.0133, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (0.4994 => 0.5097, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.04% (4.2109 => 4.2970, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.36% (1.0781 => 1.0928, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (1.9694 => 1.9960, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.26% (23.5202 => 23.8170, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.19% (0.9697 => 0.9812, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (1.9966 => 2.0202, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (2.7292 => 2.7604, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.14% (2.1653 => 2.1899, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.68% (2.4764 => 2.3606, std. dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: -2.64% (11.9555 => 11.6393, std. dev.: 0.0026) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 17:37:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 19:37:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628003712.0D94D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1580?compare_to=1577&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1580, Order: 159301, Start Time: 2012-06-27 23:42:12, End Time: 2012-06-28 00:38:47 To: 1577, Order: 159295, Start Time: 2012-06-27 22:18:31, End Time: 2012-06-27 23:15:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (736 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.15% (1.4302 => 1.4138, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.38% (2.0176 => 2.2673, std. dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.5818 => 0.6203, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5748 => 0.6113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.92% (0.7061 => 0.7479, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 5.34% (0.4328 => 0.4559, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.04% (0.7038 => 0.7393, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4062 => 0.4260, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3022 => 0.3166, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2655 => 0.2781, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.7710 => 0.8073, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.56% (1.9828 => 2.0732, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2726 => 0.2850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2760 => 0.2884, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.48% (0.2966 => 0.3099, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 4.42% (0.3578 => 0.3736, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.38% (0.2765 => 0.2886, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.35% (0.2761 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.32% (3.9660 => 4.1375, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3149 => 0.3285, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.25% (0.3601 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.22% (0.3789 => 0.3949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.20% (0.2596 => 0.2705, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.12% (0.3663 => 0.3814, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.11% (0.3650 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.09% (0.3914 => 0.4074, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3453 => 0.3594, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 4.05% (0.4003 => 0.4165, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 4.03% (0.3623 => 0.3769, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5265 => 0.5473, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 3.95% (0.2988 => 0.3106, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.88% (0.3940 => 0.4093, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.6959 => 0.7208, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (0.4390 => 0.4540, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.40% (13.8202 => 14.2906, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.4563 => 1.4983, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.78% (1.3245 => 1.3613, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.67% (0.5577 => 0.5726, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.65% (16.6129 => 17.0533, std. dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 2.63% (1.2292 => 1.2615, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.52% (0.7506 => 0.7695, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.45% (4.9865 => 5.1086, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8646 => 3.9559, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.36% (1.9270 => 1.9725, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.34% (1.1061 => 1.1320, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.31% (1.3819 => 1.4138, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (7.2180 => 7.3714, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8310 => 0.8479, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.2842 => 13.5502, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (3.6692 => 3.7412, std. dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 1.92% (14.8535 => 15.1389, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.8698 => 0.8863, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (6.5754 => 6.6923, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4557, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.71% (2.1791 => 2.2163, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (4.4433 => 4.5050, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2264, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1333 => 1.1461, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.31% (1.2998 => 1.3948, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7272, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.07% (4.1080 => 4.1931, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5089 => 1.5350, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7075, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6407, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9932, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3511 => 0.3344, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.8818 => 0.8595, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (6.2785 => 6.1992, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2308 => 1.0997, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.20% (20.3410 => 18.4700, std. dev.: 0.1274) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5795, std. dev.: 0.0127) MultiSource/Applications/minisat/minisat: -2.52% (9.3358 => 9.1001, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2493, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0208) MultiSource/Applications/spiff/spiff: -1.51% (3.0263 => 2.9807, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (28.2225 => 27.8526, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.12% (7.3305 => 7.2486, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 18:03:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 20:03:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628010315.31AF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1581?compare_to=1578&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1581, Order: 159302, Start Time: 2012-06-28 00:03:55, End Time: 2012-06-28 01:04:50 To: 1578, Order: 159296, Start Time: 2012-06-27 22:35:40, End Time: 2012-06-27 23:36:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 1 (29 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 871 (831 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.58% (10.5596 => 10.9376, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.79% (3.8483 => 3.7795, std. dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.21% (0.3473 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3543 => 0.3822, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.85% (0.3543 => 0.3821, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.53% (0.3694 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.21% (0.3886 => 0.4166, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3828 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.10% (0.3927 => 0.4206, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.50% (10.3673 => 10.9376, std. dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.4361 => 10.8770, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/Hello: 4.19% (0.5925 => 0.6173, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 3.96% (0.6030 => 0.6269, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.35% (21.9371 => 22.6716, std. dev.: 0.0182) SingleSource/UnitTests/ObjC++/property-reference: 3.26% (0.7326 => 0.7565, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (0.7433 => 0.7635, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (7.0540 => 7.2295, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.8172 => 0.8354, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.43% (8.1363 => 8.2527, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (2.2022 => 2.2314, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (7.9617 => 8.0660, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3145, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (9.4845 => 9.5864, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.9449 => 4.9971, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.0018 => 5.0529, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.67% (26.0924 => 26.7890, std. dev.: 0.0386) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6395 => 3.6804, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.54% (0.8651 => 0.7307, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.98% (5.2763 => 4.8024, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -8.11% (22.1758 => 20.3769, std. dev.: 0.0327) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.86% (2.9384 => 2.7074, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.16% (1.1194 => 1.0504, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5331, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.31% (6.6874 => 6.3995, std. dev.: 0.0162) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.35% (5.3855 => 5.3129, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5501, std. dev.: 0.0956) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9155, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6895, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 19:00:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 21:00:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628020059.6A6292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1582?compare_to=1580&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1582, Order: 159315, Start Time: 2012-06-28 01:05:56, End Time: 2012-06-28 02:02:34 To: 1580, Order: 159301, Start Time: 2012-06-27 23:42:12, End Time: 2012-06-28 00:38:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.95% (2.0176 => 2.2789, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.5818 => 0.6206, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5748 => 0.6117, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7061 => 0.7473, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.20% (0.7038 => 0.7404, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.94% (1.3693 => 1.4370, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4062 => 0.4262, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.7710 => 0.8078, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.62% (3.9660 => 4.1493, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/random: 4.61% (0.2690 => 0.2814, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 4.59% (0.2726 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (1.9828 => 2.0729, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.49% (0.2607 => 0.2724, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2765 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.39% (0.5265 => 0.5496, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3580 => 0.3730, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3192 => 0.3322, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3453 => 0.3592, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.02% (0.3578 => 0.3722, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3293 => 0.3423, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.6959 => 0.7231, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.85% (0.3789 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.85% (0.4003 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.82% (0.3663 => 0.3803, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 3.81% (0.3646 => 0.3785, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 3.80% (0.3601 => 0.3738, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.78% (0.3914 => 0.4062, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.75% (0.3650 => 0.3787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3534 => 0.3665, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 3.71% (0.3940 => 0.4086, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.70% (0.3623 => 0.3757, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.53% (13.8202 => 14.3081, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.2193 => 1.2569, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (0.4379 => 0.4507, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.92% (1.1364 => 1.1696, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0889, std. dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8646 => 3.9751, std. dev.: 0.0065) MultiSource/Applications/Burg/burg: 2.83% (1.1061 => 1.1374, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 2.78% (0.7506 => 0.7715, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.76% (1.2292 => 1.2631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1169, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.3813 => 1.4170, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.51% (1.9270 => 1.9754, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4146, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (7.2180 => 7.3841, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (13.2842 => 13.5879, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.19% (3.6692 => 3.7494, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.10% (2.1791 => 2.2248, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.99% (14.8535 => 15.1497, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (6.5754 => 6.7037, std. dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.6135 => 0.6241, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.3801 => 4.4538, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (4.4433 => 4.5145, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.37% (3.1889 => 3.2326, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 26.70% (1.8175 => 2.3028, std. dev.: 0.0371) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3971, std. dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7262, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8318, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5089 => 1.5350, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7029, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6405, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.30% (0.4657 => 0.3991, std. dev.: 0.0243) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0118, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3511 => 0.3364, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.24% (0.9108 => 0.8995, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2126, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.65% (20.3410 => 18.5814, std. dev.: 0.0328) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.47% (1.9762 => 1.9077, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5944, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.47% (9.3358 => 9.1051, std. dev.: 0.0330) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2540, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.30% (28.2225 => 27.8556, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2417, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.08% (26.5159 => 26.2300, std. dev.: 0.0229) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 19:25:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 21:25:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628022529.F0A012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1583?compare_to=1579&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1583, Order: 159304, Start Time: 2012-06-28 00:11:43, End Time: 2012-06-28 02:27:06 To: 1579, Order: 159293, Start Time: 2012-06-27 21:29:26, End Time: 2012-06-27 23:44:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (29 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.92% (0.3488 => 0.3799, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.74% (0.3442 => 0.3743, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.74% (0.3465 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.73% (0.3446 => 0.3747, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3460 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.72% (0.3496 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3469 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.37% (0.3643 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.36% (0.3650 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.16% (0.3724 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.60% (0.5826 => 0.6094, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.26% (0.5889 => 0.6140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.28% (0.7171 => 0.7406, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (0.5026 => 0.5185, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.78% (1.6211 => 1.6662, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (3.5627 => 3.6498, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.5900 => 0.6044, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (2.0673 => 2.1149, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.27% (4.2109 => 4.3063, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (1.3152 => 1.3449, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.11% (0.9909 => 1.0118, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.44% (23.5202 => 23.8591, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (1.9694 => 1.9960, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.31% (1.0781 => 1.0922, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.28% (1.9966 => 2.0221, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.25% (5.5417 => 5.6112, std. dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (2.7292 => 2.7630, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (4.4195 => 4.4706, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.15% (2.8036 => 2.8358, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.25% (11.9555 => 11.6864, std. dev.: 0.0048) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 19:31:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 21:31:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628023120.60F762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1584?compare_to=1581&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1584, Order: 159317, Start Time: 2012-06-28 01:32:04, End Time: 2012-06-28 02:32:55 To: 1581, Order: 159302, Start Time: 2012-06-28 00:03:55, End Time: 2012-06-28 01:04:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 873 (833 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3497 => 0.3743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.03% (0.3543 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.94% (0.3561 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.92% (0.3543 => 0.3788, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.63% (0.3694 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.35% (0.3828 => 0.4071, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.14% (0.3927 => 0.4168, std. dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: 4.51% (10.3673 => 10.8347, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.4361 => 10.8852, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 3.68% (21.9371 => 22.7439, std. dev.: 0.0166) SingleSource/UnitTests/ObjC++/property-reference-object: 3.55% (0.6030 => 0.6244, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7326 => 0.7525, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4615 => 0.4738, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7433 => 0.7616, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (7.0540 => 7.2110, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.8172 => 0.8346, std. dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (7.9617 => 8.0747, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.36% (8.1363 => 8.2468, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.05% (4.2646 => 4.3093, std. dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (2.2022 => 2.2252, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.89% (26.0924 => 26.8452, std. dev.: 0.0334) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4457, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.21% (3.6395 => 3.6834, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -16.17% (0.8651 => 0.7252, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (5.2763 => 4.7965, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -8.03% (22.1758 => 20.3952, std. dev.: 0.0465) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (2.9384 => 2.7029, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.41% (1.1194 => 1.0477, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -4.87% (54.1659 => 51.5261, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.40% (6.6874 => 6.3931, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.49% (5.3855 => 5.3051, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.26% (19.9488 => 18.5003, std. dev.: 0.0606) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9134, std. dev.: 0.0143) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6847, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 20:24:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 22:24:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628032450.6C18F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1585?compare_to=1582&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1585, Order: 159326, Start Time: 2012-06-28 02:29:44, End Time: 2012-06-28 03:26:25 To: 1582, Order: 159315, Start Time: 2012-06-28 01:05:56, End Time: 2012-06-28 02:02:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2780, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.5818 => 0.6203, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.49% (0.5748 => 0.6121, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.85% (0.7061 => 0.7474, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.39% (0.1986 => 0.2093, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7038 => 0.7409, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.01% (1.3693 => 1.4379, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0799, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.7710 => 0.8064, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.48% (3.9660 => 4.1436, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.22% (0.2988 => 0.3114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5265 => 0.5487, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4016 => 0.4185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.06% (0.3868 => 0.4025, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.86% (0.3578 => 0.3716, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.4390 => 0.4559, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 3.69% (0.3601 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.67% (0.4003 => 0.4150, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 3.65% (0.3914 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.64% (0.3789 => 0.3927, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.59% (0.3646 => 0.3777, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.59% (0.3650 => 0.3781, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.58% (13.8202 => 14.3145, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/synchronized: 3.58% (0.3663 => 0.3794, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.48% (0.3623 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.45% (0.3940 => 0.4076, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.06% (1.2193 => 1.2566, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.4563 => 1.5006, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0594 => 1.0916, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.1364 => 1.1698, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.90% (1.2292 => 1.2649, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.3819 => 1.4217, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3626, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (4.9865 => 5.1297, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (0.4379 => 0.4504, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.85% (16.6129 => 17.0870, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9718, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.77% (1.3813 => 1.4196, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.71% (1.1061 => 1.1361, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 2.49% (1.9270 => 1.9750, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (3.6692 => 3.7554, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (7.2180 => 7.3819, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5797, std. dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2226, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.85% (14.8535 => 15.1279, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 1.79% (6.5754 => 6.6930, std. dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.3801 => 4.4583, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6135 => 0.6240, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.4433 => 4.5165, std. dev.: 0.0114) MultiSource/Applications/d/make_dparser: 1.41% (3.1889 => 3.2340, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.5298 => 14.6819, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2748, std. dev.: 0.0438) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.27% (0.9996 => 1.0823, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3894, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7401, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6469 => 3.7120, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.55% (1.5089 => 1.5323, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9519, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.67% (0.4657 => 0.4160, std. dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0013, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.73% (0.3511 => 0.3380, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.8818 => 0.8579, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.2785 => 6.2121, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1025, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5421, std. dev.: 0.0193) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: -2.63% (9.3358 => 9.0906, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5959, std. dev.: 0.0125) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9794, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2458, std. dev.: 0.0070) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2481, std. dev.: 0.0254) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 20:59:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 22:59:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628035931.81FDC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1586?compare_to=1584&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1586, Order: 159328, Start Time: 2012-06-28 03:00:07, End Time: 2012-06-28 04:01:06 To: 1584, Order: 159317, Start Time: 2012-06-28 01:32:04, End Time: 2012-06-28 02:32:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 1 (13 on baseline) Existing Failures: 21 (19 on baseline) Unchanged Tests: 872 (823 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.82% (10.8852 => 10.6872, std. dev.: 0.0186) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.15% (0.3473 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.96% (0.3543 => 0.3825, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.95% (0.3497 => 0.3775, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.94% (0.3516 => 0.3795, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.61% (0.3694 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.37% (0.3828 => 0.4110, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3886 => 0.4169, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.18% (0.3927 => 0.4209, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 4.41% (10.3673 => 10.8248, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/Hello: 4.12% (0.5925 => 0.6169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.96% (0.6030 => 0.6269, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.58% (21.9371 => 22.7225, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/property-reference: 3.28% (0.7326 => 0.7566, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.97% (0.7433 => 0.7654, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (7.0540 => 7.2497, std. dev.: 0.0133) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8172 => 0.8381, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (10.4361 => 10.6872, std. dev.: 0.0186) MultiSource/Applications/spiff/spiff: 1.90% (0.7835 => 0.7984, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.1363 => 8.2751, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.9449 => 5.0168, std. dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.45% (7.9617 => 8.0769, std. dev.: 0.0180) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (5.0018 => 5.0730, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (2.0665 => 2.0958, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3219, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (9.4845 => 9.6029, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.5415 => 1.5606, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.04% (1.5603 => 1.5766, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 1.04% (3.3354 => 3.3700, std. dev.: 0.0084) MultiSource/Applications/treecc/treecc: 1.03% (2.0273 => 2.0481, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 1.01% (5.7591 => 5.8173, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.86% (26.0924 => 26.8383, std. dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.04% (3.7781 => 3.8173, std. dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -15.57% (0.8651 => 0.7304, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.13% (5.2763 => 4.7948, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.13% (2.9384 => 2.6994, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -7.88% (22.1758 => 20.4283, std. dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (1.1194 => 1.0456, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4877, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (6.6874 => 6.3962, std. dev.: 0.0178) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (5.3855 => 5.3166, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2373 => 1.1127, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5686, std. dev.: 0.0431) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9262, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6862, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 21:48:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 27 Jun 2012 23:48:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628044829.286C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1587?compare_to=1585&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1587, Order: 159328, Start Time: 2012-06-28 03:53:28, End Time: 2012-06-28 04:50:04 To: 1585, Order: 159326, Start Time: 2012-06-28 02:29:44, End Time: 2012-06-28 03:26:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.57% (3.7659 => 3.9004, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 6.60% (0.5818 => 0.6202, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.25% (0.5748 => 0.6107, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7061 => 0.7470, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7038 => 0.7394, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.00% (0.4062 => 0.4265, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.96% (0.2781 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.79% (1.3693 => 1.4349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.7710 => 0.8070, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.9828 => 2.0745, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.60% (0.2628 => 0.2749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.26% (3.9660 => 4.1348, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5265 => 0.5477, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.69% (0.3578 => 0.3710, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4390 => 0.4549, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.6959 => 0.7207, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 3.55% (0.3663 => 0.3793, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 3.54% (0.3789 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.46% (0.3646 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.42% (0.4003 => 0.4140, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.42% (0.3601 => 0.3724, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.37% (0.3914 => 0.4046, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.34% (13.8202 => 14.2819, std. dev.: 0.0142) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.32% (0.3650 => 0.3771, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 3.30% (0.3940 => 0.4070, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.28% (0.3623 => 0.3742, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.4563 => 1.4961, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2292 => 1.2627, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (3.8646 => 3.9694, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.64% (1.3813 => 1.4177, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.60% (0.5577 => 0.5722, std. dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0438, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.59% (4.9865 => 5.1155, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.55% (1.3245 => 1.3583, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 2.50% (0.7506 => 0.7694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (1.3819 => 1.4165, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.17% (1.9270 => 1.9689, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.10% (7.2180 => 7.3696, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (3.6692 => 3.7447, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5471, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.8698 => 0.8853, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 1.77% (14.8535 => 15.1169, std. dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 1.65% (6.5754 => 6.6837, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.64% (2.1791 => 2.2148, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.3801 => 4.4505, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.4433 => 4.5085, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.15% (3.1889 => 3.2257, std. dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0520) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7361, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6799, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 3.37% (3.7731 => 3.9004, std. dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (3.6469 => 3.7068, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9519, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9467, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2073, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1127, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.90% (20.3410 => 18.5314, std. dev.: 0.1136) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.37% (1.3780 => 1.3178, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -2.58% (9.3358 => 9.0950, std. dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9790, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.22% (0.9692 => 0.9574, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2444, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2549, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jun 27 22:07:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 00:07:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628050749.C1CF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1588?compare_to=1583&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1588, Order: 159328, Start Time: 2012-06-28 02:54:07, End Time: 2012-06-28 05:09:26 To: 1583, Order: 159304, Start Time: 2012-06-28 00:11:43, End Time: 2012-06-28 02:27:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (32 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (860 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3488 => 0.3789, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 8.42% (0.3446 => 0.3736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3465 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.32% (0.3496 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.31% (0.3442 => 0.3728, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.29% (0.3460 => 0.3747, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3469 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3643 => 0.3941, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.89% (0.3650 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.3724 => 0.4014, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.31% (0.5826 => 0.6077, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.92% (0.5889 => 0.6120, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (0.5026 => 0.5192, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.05% (0.5900 => 0.6080, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 2.94% (0.7171 => 0.7382, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (1.6211 => 1.6670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.58% (3.5627 => 3.6546, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (2.0673 => 2.1192, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.41% (0.9909 => 1.0148, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.39% (1.3152 => 1.3466, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.27% (4.2109 => 4.3066, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.54% (1.9694 => 1.9998, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.54% (23.5202 => 23.8822, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.46% (1.9966 => 2.0257, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.39% (4.4195 => 4.4809, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.25% (2.1653 => 2.1924, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (2.7292 => 2.7623, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 1.21% (1.8794 => 1.9021, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.13% (4.6177 => 4.6698, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.10% (5.5417 => 5.6026, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 1.54% (2.8036 => 2.8469, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.56% (2.4764 => 2.3635, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: -2.32% (11.9555 => 11.6777, std. dev.: 0.0026) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 00:14:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 02:14:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628071457.B07A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1589?compare_to=1587&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1589, Order: 159332, Start Time: 2012-06-28 06:17:31, End Time: 2012-06-28 07:16:33 To: 1587, Order: 159328, Start Time: 2012-06-28 03:53:28, End Time: 2012-06-28 04:50:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (761 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2680, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.5818 => 0.6205, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.47% (0.5748 => 0.6120, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7061 => 0.7486, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.7710 => 0.8091, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.9828 => 2.0803, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2988 => 0.3120, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2596 => 0.2709, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.25% (0.5265 => 0.5489, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.21% (3.9660 => 4.1330, std. dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 3.75% (0.3578 => 0.3712, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 3.58% (0.3601 => 0.3730, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.56% (0.3650 => 0.3780, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 3.53% (0.3914 => 0.4052, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 3.51% (0.3646 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.51% (0.3789 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.50% (0.4003 => 0.4143, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 3.49% (0.3663 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.39% (0.3623 => 0.3746, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 3.27% (0.3940 => 0.4069, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3626, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.4563 => 1.4981, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.2193 => 1.2537, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4194, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5577 => 0.5728, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (0.4379 => 0.4494, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (3.8646 => 3.9656, std. dev.: 0.0316) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.59% (1.3813 => 1.4171, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5814, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.22% (7.2180 => 7.3780, std. dev.: 0.0452) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.14% (3.6692 => 3.7476, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.3801 => 4.4542, std. dev.: 0.0269) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.4433 => 4.5084, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: 6.79% (1.2998 => 1.3881, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7042, std. dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1918, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9491, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9020, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.8818 => 0.8550, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (6.2785 => 6.2011, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1090, std. dev.: 0.0397) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5421, std. dev.: 0.0519) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0248) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5852, std. dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9793, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2432, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2594, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 00:19:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 02:19:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628071933.25DA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1590?compare_to=1586&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1590, Order: 159332, Start Time: 2012-06-28 06:17:35, End Time: 2012-06-28 07:21:08 To: 1586, Order: 159328, Start Time: 2012-06-28 03:00:07, End Time: 2012-06-28 04:01:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 1 (1 on baseline) Performance Regressions: 12 (32 on baseline) Performance Improvements: 12 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 849 (824 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.77% (10.8248 => 13.6142, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 20.98% (1.0456 => 1.2650, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.81% (1.7440 => 1.8977, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 7.25% (0.1434 => 0.1538, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (2.2207 => 2.3556, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.52% (0.4804 => 0.5069, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.98% (0.3150 => 0.3307, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (10.6872 => 10.9678, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (7.2497 => 7.3717, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6780 => 2.9749, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6726 => 3.7473, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6532 => 2.6882, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.3962 => 0.1249, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -76.46% (0.7304 => 0.1719, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.91% (4.7948 => 3.1689, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3224 => 3.6981, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.38% (5.3166 => 3.7014, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.63% (2.6994 => 2.5474, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.41% (20.4283 => 19.3229, std. dev.: 0.0446) MultiSource/Applications/JM/lencod/lencod: -3.78% (22.7225 => 21.8646, std. dev.: 0.0438) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.79% (8.0769 => 7.8515, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.48% (0.8143 => 0.7941, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0402 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2761 => 10.0829, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.32% (10.3673 => 13.6142, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.01% (1.1194 => 1.2650, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.77% (1.7609 => 1.8977, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 7.14% (0.3473 => 0.3721, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 7.09% (0.3497 => 0.3745, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.97% (2.2022 => 2.3556, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.89% (0.3543 => 0.3787, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.88% (0.3516 => 0.3758, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3561 => 0.3806, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 6.66% (0.3694 => 0.3940, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9678, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.50% (7.0540 => 7.3717, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.09% (0.3177 => 0.3307, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.89% (0.4879 => 0.5069, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 3.46% (0.5925 => 0.6130, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7433 => 0.7660, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.15% (4.9449 => 5.0512, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (5.0018 => 5.1003, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (9.4845 => 9.6393, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2646 => 4.3244, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1363 => 8.2419, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.02% (1.5415 => 1.5573, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7473, std. dev.: 0.0149) MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.7985, std. dev.: 0.0312) SingleSource/Benchmarks/Dhrystone/dry: 1.38% (2.4116 => 2.4450, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1689, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7014, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.91% (5.3526 => 3.6981, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5474, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.86% (22.1758 => 19.3229, std. dev.: 0.0446) SingleSource/UnitTests/Vector/constpool: -4.80% (54.1659 => 51.5646, std. dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8101 => 0.7941, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.38% (7.9617 => 7.8515, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2373 => 1.1145, std. dev.: 0.0398) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.20% (19.9488 => 18.5134, std. dev.: 0.0497) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9239, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6848, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0829, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.3677 => 1.3533, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 01:34:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 03:34:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628083459.AE9A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1591?compare_to=1588&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1591, Order: 159332, Start Time: 2012-06-28 06:17:17, End Time: 2012-06-28 08:36:35 To: 1588, Order: 159328, Start Time: 2012-06-28 02:54:07, End Time: 2012-06-28 05:09:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (31 on baseline) Performance Improvements: 1 (1 on baseline) Unchanged Tests: 892 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 28.34% (0.3941 => 0.5058, std. dev.: 0.0282) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.35% (2.8469 => 2.8086, std. dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 33.39% (0.3792 => 0.5058, std. dev.: 0.0282) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.17% (0.3488 => 0.3773, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3446 => 0.3711, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3465 => 0.3731, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 7.67% (0.3496 => 0.3764, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 7.50% (0.3442 => 0.3700, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-3: 7.49% (0.3460 => 0.3719, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/synchronized: 7.38% (0.3469 => 0.3725, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3643 => 0.3902, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.3724 => 0.3986, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.5900 => 0.6094, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (0.5026 => 0.5189, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.78% (1.6211 => 1.6661, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (0.3930 => 0.4037, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.46% (0.4994 => 0.5117, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.46% (4.2109 => 4.3146, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (3.5627 => 3.6492, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3455, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.28% (0.9909 => 1.0135, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0673 => 2.1143, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.20% (1.0781 => 1.1018, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (4.4195 => 4.4961, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (1.9694 => 2.0013, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.46% (1.9966 => 2.0257, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.44% (2.1653 => 2.1964, std. dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 1.37% (5.5417 => 5.6178, std. dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 1.29% (4.6177 => 4.6771, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.26% (0.9697 => 0.9819, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (2.7292 => 2.7613, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.05% (1.8794 => 1.8992, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.37% (11.9555 => 11.6721, std. dev.: 0.0129) Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 01:39:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 03:39:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628083905.711F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1592?compare_to=1589&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1592, Order: 159333, Start Time: 2012-06-28 07:43:55, End Time: 2012-06-28 08:40:41 To: 1589, Order: 159332, Start Time: 2012-06-28 06:17:31, End Time: 2012-06-28 07:16:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (736 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.22% (0.8524 => 0.8335, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2682, std. dev.: 0.0152) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.5818 => 0.6205, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.49% (0.5748 => 0.6121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7061 => 0.7478, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.7710 => 0.8102, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.00% (1.3693 => 1.4377, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.97% (1.9828 => 2.0813, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.67% (0.3489 => 0.3652, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2596 => 0.2709, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.31% (3.9660 => 4.1370, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5265 => 0.5488, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.80% (0.3578 => 0.3714, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.6959 => 0.7223, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.78% (0.4390 => 0.4556, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 3.60% (0.3914 => 0.4055, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.57% (0.4003 => 0.4146, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.56% (0.3650 => 0.3780, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 3.53% (0.3601 => 0.3728, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.48% (0.3789 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.48% (0.3646 => 0.3773, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.43% (13.8202 => 14.2949, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 3.41% (0.3663 => 0.3788, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9199 => 0.9511, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.37% (0.3623 => 0.3745, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 3.25% (0.3940 => 0.4068, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.04% (1.2292 => 1.2666, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.4563 => 1.4988, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (0.4379 => 0.4498, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1668, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.63% (1.3245 => 1.3593, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (3.8646 => 3.9651, std. dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0424, std. dev.: 0.0177) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.51% (1.3819 => 1.4166, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.38% (4.9865 => 5.1052, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.2842 => 13.5864, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (7.2180 => 7.3804, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (3.6692 => 3.7395, std. dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (6.5754 => 6.6924, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.8698 => 0.8852, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.74% (2.1791 => 2.2171, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 1.70% (14.8535 => 15.1060, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.3801 => 4.4523, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5067, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2282, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6983, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.17% (1.2998 => 1.4060, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7297, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6801, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.22% (12.0921 => 12.4813, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6469 => 3.7156, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9041, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (6.2785 => 6.1998, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2308 => 1.1117, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.28% (20.3410 => 18.4537, std. dev.: 0.0819) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5760, std. dev.: 0.0169) MultiSource/Applications/minisat/minisat: -2.58% (9.3358 => 9.0948, std. dev.: 0.0330) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 01:48:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 03:48:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628084825.355772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1593?compare_to=1590&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1593, Order: 159333, Start Time: 2012-06-28 07:48:32, End Time: 2012-06-28 08:49:59 To: 1590, Order: 159332, Start Time: 2012-06-28 06:17:35, End Time: 2012-06-28 07:21:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (815 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.26% (10.3673 => 13.6077, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2642, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.77% (1.7609 => 1.8977, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.26% (0.3473 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.12% (0.3497 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.03% (0.3543 => 0.3792, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.00% (0.3543 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3561 => 0.3809, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.96% (2.2022 => 2.3554, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.71% (0.3694 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.3927 => 0.4183, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 6.48% (0.3828 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.38% (0.3886 => 0.4134, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 5.02% (10.4361 => 10.9599, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (7.0540 => 7.3668, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.84% (0.3177 => 0.3299, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.68% (0.5925 => 0.6143, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.53% (0.6030 => 0.6243, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7433 => 0.7659, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 2.84% (0.7326 => 0.7534, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (5.0018 => 5.1017, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (4.9449 => 5.0398, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (9.4845 => 9.6346, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.2646 => 4.3241, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (8.1363 => 8.2484, std. dev.: 0.0101) MultiSource/Applications/treecc/treecc: 1.12% (2.0273 => 2.0500, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (2.0665 => 2.0891, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.03% (3.3354 => 3.3699, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8254, std. dev.: 0.0278) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1699, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7014, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.82% (5.3526 => 3.7029, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5455, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.90% (22.1758 => 19.3151, std. dev.: 0.0395) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5445, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.56% (3.8922 => 3.7925, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8101 => 0.7949, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.57% (7.9617 => 7.8367, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2373 => 1.1079, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.03% (19.9488 => 18.5459, std. dev.: 0.0299) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9200, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6862, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0799, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 03:02:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 05:02:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628100241.B4E592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1594?compare_to=1592&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1594, Order: 159336, Start Time: 2012-06-28 09:07:41, End Time: 2012-06-28 10:04:17 To: 1592, Order: 159333, Start Time: 2012-06-28 07:43:55, End Time: 2012-06-28 08:40:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2675, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5818 => 0.6166, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.69% (0.5748 => 0.6075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.34% (0.4328 => 0.4559, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.25% (0.7061 => 0.7432, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7038 => 0.7386, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4062 => 0.4256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.73% (1.3693 => 1.4341, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2782 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3022 => 0.3152, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.26% (0.2655 => 0.2768, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.25% (1.9828 => 2.0670, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.25% (3.9660 => 4.1344, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.24% (0.7710 => 0.8037, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.2966 => 0.3091, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3899 => 0.4060, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5265 => 0.5479, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.06% (0.2761 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3107 => 0.3232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3489 => 0.3625, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 3.63% (0.3192 => 0.3308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.49% (0.3578 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.4016 => 0.4156, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3293 => 0.3407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (0.3756 => 0.3884, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.40% (13.8202 => 14.2896, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 3.35% (0.4003 => 0.4137, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.35% (0.3646 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.4390 => 0.4536, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 3.32% (0.3914 => 0.4044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3534 => 0.3651, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.30% (0.3789 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.28% (0.3601 => 0.3719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.25% (0.3663 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.23% (0.3650 => 0.3768, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.23% (0.3623 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 2.73% (16.6129 => 17.0660, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.4563 => 1.4960, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (3.8646 => 3.9661, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.60% (1.1061 => 1.1349, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.53% (0.5577 => 0.5718, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1123, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (1.3245 => 1.3575, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.48% (0.7506 => 0.7692, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.41% (1.9270 => 1.9735, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.2292 => 1.2586, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.31% (1.3813 => 1.4132, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (7.2180 => 7.3713, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.2842 => 13.5636, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2217, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7386, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.77% (14.8535 => 15.1158, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.8698 => 0.8850, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (6.5754 => 6.6871, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.3801 => 4.4485, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5069, std. dev.: 0.0075) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2320, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.91% (1.8175 => 2.2885, std. dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4036, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7223, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (3.6469 => 3.7096, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.51% (1.5089 => 1.5317, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9574, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.94% (0.4657 => 0.4008, std. dev.: 0.0173) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9611, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.33% (0.3511 => 0.3359, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2042, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1090, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (20.3410 => 18.5844, std. dev.: 0.0332) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5970, std. dev.: 0.0258) SingleSource/Benchmarks/Dhrystone/dry: -2.43% (2.5089 => 2.4479, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.37% (9.3358 => 9.1150, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.5254 => 2.4867, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.45% (6.3560 => 6.2637, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2443, std. dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 03:17:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 05:17:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628101720.1F7112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1595?compare_to=1593&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1595, Order: 159340, Start Time: 2012-06-28 09:17:56, End Time: 2012-06-28 10:18:55 To: 1593, Order: 159333, Start Time: 2012-06-28 07:48:32, End Time: 2012-06-28 08:49:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.99% (13.6077 => 13.0646, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.02% (10.3673 => 13.0646, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.26% (1.1194 => 1.2566, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.37% (1.7609 => 1.8906, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.69% (0.3543 => 0.3780, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.36% (2.2022 => 2.3422, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 6.25% (0.3473 => 0.3690, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.12% (0.3497 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.04% (0.3561 => 0.3776, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.03% (0.3516 => 0.3728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3543 => 0.3756, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.82% (0.3694 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.59% (0.3828 => 0.4042, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.58% (0.3927 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.51% (0.3886 => 0.4100, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.89% (10.4361 => 10.9462, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (7.0540 => 7.3364, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.63% (0.4879 => 0.5056, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.37% (0.3177 => 0.3284, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.00% (0.6030 => 0.6211, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.94% (0.5925 => 0.6099, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7433 => 0.7629, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.14% (0.7326 => 0.7483, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.8172 => 0.8318, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.58% (0.7835 => 0.7959, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.9449 => 5.0222, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (5.0018 => 5.0783, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (9.4845 => 9.6046, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.1363 => 8.2267, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.2646 => 4.3107, std. dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7675, std. dev.: 0.0467) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3045 => 1.3186, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1568, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6901, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.13% (5.3526 => 3.6864, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5391, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.93% (22.1758 => 19.3089, std. dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4699, std. dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.79% (3.8922 => 3.7837, std. dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.93% (0.8101 => 0.7945, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.78% (7.9617 => 7.8200, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5674, std. dev.: 0.0243) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9173, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6880, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0833, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 04:17:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 06:17:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628111745.555072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1596?compare_to=1591&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1596, Order: 159336, Start Time: 2012-06-28 09:03:49, End Time: 2012-06-28 11:19:22 To: 1591, Order: 159332, Start Time: 2012-06-28 06:17:17, End Time: 2012-06-28 08:36:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (25 on baseline) Performance Improvements: 4 (2 on baseline) Unchanged Tests: 888 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.28% (0.2128 => 0.2283, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.2257 => 0.2380, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.15% (2.0522 => 2.0286, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: -1.11% (1.1018 => 1.0896, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.08% (0.9819 => 0.9713, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -1.02% (1.6082 => 1.5918, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.55% (0.3465 => 0.3692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3446 => 0.3670, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.47% (0.3460 => 0.3684, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.46% (0.3496 => 0.3722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.42% (0.3488 => 0.3712, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.34% (0.3469 => 0.3689, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3643 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.30% (0.3442 => 0.3659, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.11% (0.3650 => 0.3873, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3724 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.99% (0.5826 => 0.6000, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (0.5026 => 0.5174, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.68% (0.5889 => 0.6047, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.31% (1.6211 => 1.6586, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (0.4994 => 0.5107, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (3.5627 => 3.6360, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (1.3152 => 1.3402, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.84% (4.2109 => 4.2883, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 1.65% (0.7171 => 0.7289, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.53% (2.0673 => 2.0990, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.39% (0.9909 => 1.0047, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.07% (1.0781 => 1.0896, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (4.4195 => 4.4655, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.18% (2.4764 => 2.3728, std. dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: -2.85% (11.9555 => 11.6150, std. dev.: 0.0053) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 04:26:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 06:26:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628112615.038CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1597?compare_to=1594&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1597, Order: 159344, Start Time: 2012-06-28 10:31:19, End Time: 2012-06-28 11:27:52 To: 1594, Order: 159336, Start Time: 2012-06-28 09:07:41, End Time: 2012-06-28 10:04:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.33% (3.7626 => 3.8126, std. dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.14% (2.0176 => 2.2626, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.5818 => 0.6168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5748 => 0.6078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7061 => 0.7437, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4328 => 0.4548, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.77% (0.7038 => 0.7374, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.75% (1.3693 => 1.4344, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 4.46% (0.4062 => 0.4243, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.37% (0.2607 => 0.2721, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.35% (0.2782 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.34% (0.2765 => 0.2885, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2596 => 0.2706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2628 => 0.2739, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.22% (0.2655 => 0.2767, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.7710 => 0.8034, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (3.9660 => 4.1318, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.08% (1.9828 => 2.0637, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2966 => 0.3086, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.04% (0.3489 => 0.3630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.02% (0.3107 => 0.3232, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5265 => 0.5475, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.97% (0.3149 => 0.3274, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2761 => 0.2869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.59% (0.4016 => 0.4160, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.44% (0.3578 => 0.3701, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3868 => 0.4000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.38% (0.3756 => 0.3883, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.38% (13.8202 => 14.2873, std. dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-2: 3.33% (0.3601 => 0.3721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.28% (0.3663 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.27% (0.3789 => 0.3913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9199 => 0.9500, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 3.26% (0.3646 => 0.3765, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.22% (0.4003 => 0.4132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.18% (0.3650 => 0.3766, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 3.12% (0.3623 => 0.3736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.10% (0.3940 => 0.4062, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.4563 => 1.4947, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4379 => 0.4493, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0337, std. dev.: 0.0215) MultiSource/Applications/spiff/spiff: 2.53% (0.7506 => 0.7696, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (1.3245 => 1.3572, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.44% (4.9865 => 5.1082, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 2.43% (3.8646 => 3.9586, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.32% (1.2292 => 1.2577, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.26% (1.9270 => 1.9706, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.25% (1.3819 => 1.4130, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4120, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.05% (7.2180 => 7.3657, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8310 => 0.8480, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (13.2842 => 13.5540, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7363, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.83% (2.1791 => 2.2189, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.8698 => 0.8846, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (6.5754 => 6.6815, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0901, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.47% (4.3801 => 4.4443, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (4.4433 => 4.5045, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2258, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0562) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7312, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6469 => 3.7148, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8641, std. dev.: 0.0260) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.54% (0.4657 => 0.3980, std. dev.: 0.0214) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9562, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.47% (0.3511 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.37% (6.2785 => 6.1927, std. dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: -1.23% (33.2944 => 32.8849, std. dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5256, std. dev.: 0.0382) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5802, std. dev.: 0.0255) MultiSource/Applications/minisat/minisat: -2.51% (9.3358 => 9.1013, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2590, std. dev.: 0.0088) MultiSource/Applications/spiff/spiff: -1.50% (3.0263 => 2.9810, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 04:45:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 06:45:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628114542.0468D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1598?compare_to=1595&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1598, Order: 159344, Start Time: 2012-06-28 10:46:07, End Time: 2012-06-28 11:47:19 To: 1595, Order: 159340, Start Time: 2012-06-28 09:17:56, End Time: 2012-06-28 10:18:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (37 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.00% (13.0646 => 13.4563, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.80% (10.3673 => 13.4563, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2587, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.75% (1.7609 => 1.8974, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.46% (2.2022 => 2.3445, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3473 => 0.3695, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 6.29% (0.3497 => 0.3717, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.24% (0.3543 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.20% (0.3516 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.18% (0.3543 => 0.3762, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3561 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.98% (0.3694 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.72% (0.3828 => 0.4047, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.66% (0.3886 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.63% (0.3927 => 0.4148, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (10.4361 => 10.9514, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (7.0540 => 7.3433, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.65% (0.3177 => 0.3293, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 3.35% (0.3282 => 0.3392, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.32% (0.6030 => 0.6230, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5925 => 0.6117, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (0.7433 => 0.7639, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 2.58% (0.7326 => 0.7515, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (5.0018 => 5.0902, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.9449 => 5.0315, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.66% (0.7835 => 0.7965, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (9.4845 => 9.6344, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.8172 => 0.8301, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3181, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.18% (8.1363 => 8.2327, std. dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7588, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8081, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4459, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1672, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6926, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6873, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5368, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.75% (22.1758 => 19.3479, std. dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4745, std. dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.64% (3.8922 => 3.7893, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8101 => 0.7941, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.63% (7.9617 => 7.8322, std. dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2373 => 1.1024, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.05% (19.9488 => 18.5416, std. dev.: 0.0382) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9107, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6917, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 07:00:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 09:00:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628140019.C813F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1599?compare_to=1596&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1599, Order: 159344, Start Time: 2012-06-28 11:46:22, End Time: 2012-06-28 14:01:56 To: 1596, Order: 159336, Start Time: 2012-06-28 09:03:49, End Time: 2012-06-28 11:19:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (33 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (859 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 27.11% (0.3736 => 0.4749, std. dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 25.24% (0.3792 => 0.4749, std. dev.: 0.0142) SingleSource/UnitTests/ObjC/exceptions-2: 7.46% (0.3446 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.45% (0.3465 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.43% (0.3488 => 0.3747, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.38% (0.3496 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.35% (0.3469 => 0.3724, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3460 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3442 => 0.3693, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.27% (0.3643 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.93% (0.3650 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3724 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.48% (0.5826 => 0.6029, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.38% (0.5889 => 0.6088, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (0.5026 => 0.5190, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.05% (0.5900 => 0.6080, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (1.6211 => 1.6666, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.69% (0.7171 => 0.7364, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (0.4994 => 0.5119, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (3.5627 => 3.6490, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3455, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.24% (4.2109 => 4.3053, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (0.5000 => 0.5101, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.46% (1.9694 => 1.9982, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (2.0673 => 2.0967, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.42% (1.0781 => 1.0934, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (2.7292 => 2.7679, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.39% (0.9909 => 1.0047, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (4.4195 => 4.4763, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.24% (1.8794 => 1.9027, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (1.9966 => 2.0194, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (2.1653 => 2.1898, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 1.01% (1.4269 => 1.4413, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.2122 => 0.2270, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.47% (2.4764 => 2.3657, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: -2.79% (11.9555 => 11.6219, std. dev.: 0.0123) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 09:01:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 11:01:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628160154.11B9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1600?compare_to=1597&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1600, Order: 159350, Start Time: 2012-06-28 15:06:55, End Time: 2012-06-28 16:03:30 To: 1597, Order: 159344, Start Time: 2012-06-28 10:31:19, End Time: 2012-06-28 11:27:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (737 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4328 => 0.4603, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.5818 => 0.6175, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.93% (0.5748 => 0.6089, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.40% (0.7061 => 0.7442, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4062 => 0.4272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.06% (1.3693 => 1.4386, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.77% (0.7038 => 0.7374, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.51% (0.3192 => 0.3336, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.28% (3.9660 => 4.1358, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2596 => 0.2706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.7710 => 0.8033, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.08% (0.4016 => 0.4180, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5265 => 0.5479, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.6959 => 0.7209, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.38% (13.8202 => 14.2869, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.30% (0.3578 => 0.3696, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 3.18% (0.3646 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3601 => 0.3715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.15% (0.3650 => 0.3765, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 3.15% (0.4003 => 0.4129, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 3.14% (0.3789 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.99% (1.2292 => 1.2660, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.94% (0.7506 => 0.7727, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.70% (1.4563 => 1.4956, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.9865 => 5.1195, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2193 => 1.2515, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.58% (16.6129 => 17.0414, std. dev.: 0.0200) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.3245 => 1.3571, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (3.8646 => 3.9571, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.37% (1.3819 => 1.4147, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9713, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.25% (1.3813 => 1.4124, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3703, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5612, std. dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.8698 => 0.8879, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (3.6692 => 3.7431, std. dev.: 0.0163) MultiSource/Applications/siod/siod: 1.71% (2.1791 => 2.2163, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (6.5754 => 6.6869, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0969, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.54% (4.3801 => 4.4477, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5068, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.30% (3.1889 => 3.2303, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel-2: 8.69% (1.2998 => 1.4127, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7235, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.5627 => 20.9814, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.32% (6.2785 => 6.1959, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.08% (1.2308 => 1.1067, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.33% (20.3410 => 18.4437, std. dev.: 0.0827) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5825, std. dev.: 0.0232) MultiSource/Applications/minisat/minisat: -2.66% (9.3358 => 9.0879, std. dev.: 0.0356) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5027, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.60% (3.9173 => 3.8548, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2568, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9798, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2439, std. dev.: 0.0097) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2361, std. dev.: 0.0289) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 09:06:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 11:06:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628160643.16F372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1601?compare_to=1598&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1601, Order: 159350, Start Time: 2012-06-28 15:07:10, End Time: 2012-06-28 16:08:20 To: 1598, Order: 159344, Start Time: 2012-06-28 10:46:07, End Time: 2012-06-28 11:47:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (815 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.92% (10.3673 => 13.4692, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2642, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (1.7609 => 1.8989, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 7.20% (0.3473 => 0.3723, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.17% (0.3516 => 0.3768, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 7.06% (0.3497 => 0.3744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.03% (0.3543 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.00% (0.3543 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3561 => 0.3809, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.91% (2.2022 => 2.3544, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.74% (0.3694 => 0.3943, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.45% (0.3828 => 0.4075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.36% (0.3886 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3927 => 0.4176, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (10.4361 => 11.0217, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.13% (7.0540 => 7.3454, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.03% (0.3177 => 0.3305, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 3.90% (0.3282 => 0.3410, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.32% (0.5925 => 0.6122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.6030 => 0.6220, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.98% (0.7326 => 0.7544, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (5.0018 => 5.0929, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.9449 => 5.0313, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.8172 => 0.8310, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6194, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.1363 => 8.2520, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0665 => 2.0942, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.33% (1.5603 => 1.5811, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.2646 => 4.3164, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.73% (26.0924 => 26.8054, std. dev.: 0.0383) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5384, std. dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.72% (5.2763 => 3.1804, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (5.3855 => 3.7053, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6961, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5483, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: -12.86% (22.1758 => 19.3242, std. dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3562, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.57% (3.8922 => 3.7920, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.85% (0.8101 => 0.7951, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.58% (7.9617 => 7.8363, std. dev.: 0.0261) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1046, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.21% (19.9488 => 18.5105, std. dev.: 0.0486) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9147, std. dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6767, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 10:20:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 12:20:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628172049.DE3252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1602?compare_to=1599&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1602, Order: 159350, Start Time: 2012-06-28 15:06:52, End Time: 2012-06-28 17:22:27 To: 1599, Order: 159344, Start Time: 2012-06-28 11:46:22, End Time: 2012-06-28 14:01:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (33 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 891 (859 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (2.0967 => 2.1241, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 1.10% (1.0047 => 1.0158, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.28% (0.4749 => 0.3881, std. dev.: 0.0308) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3446 => 0.3712, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3465 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.68% (0.3488 => 0.3756, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.67% (0.3496 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.66% (0.3460 => 0.3725, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.61% (0.3442 => 0.3704, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 7.58% (0.3469 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.44% (0.3643 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.06% (0.3724 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5826 => 0.6046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.52% (0.5889 => 0.6096, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (0.5026 => 0.5196, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (1.6211 => 1.6666, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7171 => 0.7370, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0673 => 2.1241, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.69% (0.5900 => 0.6059, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (3.5627 => 3.6567, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.51% (0.9909 => 1.0158, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (1.3152 => 1.3474, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (0.4994 => 0.5112, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.13% (4.2109 => 4.3006, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.12% (0.5000 => 0.5106, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (4.4195 => 4.4968, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 1.63% (1.0781 => 1.0957, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.60% (23.5202 => 23.8962, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (1.9694 => 1.9986, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 1.44% (0.9697 => 0.9837, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (1.9966 => 2.0240, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (2.7292 => 2.7630, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (2.1653 => 2.1920, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 1.12% (4.6177 => 4.6693, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.8036 => 2.8327, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.99% (2.4764 => 2.3776, std. dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: -2.66% (11.9555 => 11.6378, std. dev.: 0.0033) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 10:25:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 12:25:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628172526.D59922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1603?compare_to=1600&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1603, Order: 159351, Start Time: 2012-06-28 16:30:29, End Time: 2012-06-28 17:27:03 To: 1600, Order: 159350, Start Time: 2012-06-28 15:06:55, End Time: 2012-06-28 16:03:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.03% (18.4437 => 18.6338, std. dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.49% (1.4127 => 1.3917, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5748 => 0.6099, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7061 => 0.7459, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4062 => 0.4266, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4374, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.97% (1.9828 => 2.0813, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2765 => 0.2897, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7038 => 0.7373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.31% (3.9660 => 4.1368, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.7710 => 0.8035, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5265 => 0.5477, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.6959 => 0.7212, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4390 => 0.4547, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2917, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9199 => 0.9502, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.90% (1.2292 => 1.2648, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 2.88% (0.3578 => 0.3681, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.74% (1.4563 => 1.4962, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.71% (0.3914 => 0.4020, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.1364 => 1.1671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 2.70% (0.4003 => 0.4111, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (4.9865 => 5.1190, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.60% (0.5577 => 0.5722, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.52% (16.6129 => 17.0319, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9613, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.48% (1.3245 => 1.3573, std. dev.: 0.0072) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.44% (1.1061 => 1.1331, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.3813 => 1.4128, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.3819 => 1.4127, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.21% (1.9270 => 1.9695, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5584, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.8698 => 0.8874, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (7.2180 => 7.3637, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (3.6692 => 3.7430, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2165, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1076, std. dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6827, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (4.3801 => 4.4448, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5069, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.32% (3.1889 => 3.2310, std. dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2729, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.07% (1.2998 => 1.3917, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7231, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6469 => 3.7166, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9847, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.47% (0.3511 => 0.3389, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.2785 => 6.1944, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (20.3410 => 18.6338, std. dev.: 0.0161) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5880, std. dev.: 0.0069) MultiSource/Applications/minisat/minisat: -2.50% (9.3358 => 9.1023, std. dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5114, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2542, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9789, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.55% (0.6589 => 0.6487, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4874, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.06% (3.9173 => 3.8757, std. dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 10:35:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 12:35:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628173500.630A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1604?compare_to=1601&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1604, Order: 159351, Start Time: 2012-06-28 16:35:25, End Time: 2012-06-28 17:36:36 To: 1601, Order: 159350, Start Time: 2012-06-28 15:07:10, End Time: 2012-06-28 16:08:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.88% (10.3673 => 13.4650, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.71% (1.1194 => 1.2617, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3524, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3473 => 0.3707, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3516 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3543 => 0.3773, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 6.49% (0.3497 => 0.3724, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.46% (0.3543 => 0.3772, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.40% (0.3561 => 0.3789, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.23% (0.3694 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3828 => 0.4060, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.91% (0.3927 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.87% (0.3886 => 0.4114, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.58% (10.4361 => 11.0183, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (7.0540 => 7.3378, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.75% (0.3177 => 0.3296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.12% (0.5925 => 0.6110, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.6030 => 0.6218, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.25% (0.7326 => 0.7491, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.9449 => 5.0401, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (5.0018 => 5.0864, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.8172 => 0.8296, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (9.4845 => 9.6158, std. dev.: 0.0200) MultiSource/Applications/spiff/spiff: 1.28% (0.7835 => 0.7935, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.24% (1.5603 => 1.5796, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (8.1363 => 8.2357, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.2646 => 4.3136, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.13% (2.0665 => 2.0898, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7602, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.72% (26.0924 => 26.8013, std. dev.: 0.0468) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6859, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.82% (5.2763 => 3.1755, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6994, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6921, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5397, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.87% (22.1758 => 19.3221, std. dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3021, std. dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.64% (3.8922 => 3.7895, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.8101 => 0.7955, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (7.9617 => 7.8296, std. dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.49% (19.9488 => 18.4553, std. dev.: 0.0838) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9216, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6880, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 11:49:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 13:49:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628184906.5DB162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1605?compare_to=1603&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1605, Order: 159357, Start Time: 2012-06-28 17:54:05, End Time: 2012-06-28 18:50:42 To: 1603, Order: 159351, Start Time: 2012-06-28 16:30:29, End Time: 2012-06-28 17:27:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (742 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 1.33% (9.1023 => 9.2233, std. dev.: 0.0304) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2885, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5748 => 0.6085, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 5.59% (0.5818 => 0.6143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4328 => 0.4555, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7038 => 0.7386, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7061 => 0.7405, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.82% (1.3693 => 1.4353, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1514, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.4062 => 0.4248, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5265 => 0.5494, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.7710 => 0.8040, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.26% (0.2607 => 0.2718, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.26% (0.2726 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (1.9828 => 2.0642, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.08% (0.3580 => 0.3726, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.3489 => 0.3629, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3485 => 0.3619, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.59% (0.3534 => 0.3661, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.45% (13.8202 => 14.2972, std. dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4390 => 0.4539, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3868 => 0.3990, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.4563 => 1.4998, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (0.4379 => 0.4504, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.79% (1.2193 => 1.2533, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.3245 => 1.3611, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 2.72% (0.4003 => 0.4112, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.69% (0.5577 => 0.5727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.68% (0.3914 => 0.4019, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 2.67% (0.3789 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.64% (0.3940 => 0.4044, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.60% (1.1061 => 1.1349, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1151, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9633, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0329, std. dev.: 0.0152) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4141, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.37% (1.2292 => 1.2583, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.3819 => 1.4140, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.23% (7.2180 => 7.3791, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (3.6692 => 3.7493, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5730, std. dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 1.81% (14.8535 => 15.1226, std. dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (6.5754 => 6.6938, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.77% (2.1791 => 2.2176, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.8698 => 0.8842, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (4.4433 => 4.5133, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (4.3801 => 4.4490, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.40% (3.1889 => 3.2335, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6983, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2711, std. dev.: 0.0387) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3868, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7177, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.56% (3.6469 => 3.7039, std. dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9421, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3511 => 0.3376, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2046, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.94% (20.3410 => 18.5229, std. dev.: 0.0396) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5862, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2518, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8475, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2483, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std. dev.: 0.0304) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2315, std. dev.: 0.0231) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 12:03:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 14:03:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628190329.6BE9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1606?compare_to=1604&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1606, Order: 159357, Start Time: 2012-06-28 18:03:55, End Time: 2012-06-28 19:05:06 To: 1604, Order: 159351, Start Time: 2012-06-28 16:35:25, End Time: 2012-06-28 17:36:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (38 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 871 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 1.24% (9.1234 => 9.2365, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/lowercase: 1.05% (7.9662 => 8.0498, std. dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.49% (13.4650 => 12.8607, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.05% (10.3673 => 12.8607, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.97% (1.1194 => 1.2646, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.55% (1.7609 => 1.8938, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 7.20% (0.3473 => 0.3723, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.20% (2.2022 => 2.3607, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.92% (0.3543 => 0.3788, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3543 => 0.3783, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 6.68% (0.3561 => 0.3799, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3694 => 0.3933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.29% (0.3927 => 0.4174, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.07% (0.3886 => 0.4122, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9748, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.53% (0.3177 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3617, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.72% (0.5925 => 0.6086, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7326 => 0.7518, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4615 => 0.4735, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 2.55% (0.6030 => 0.6184, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.49% (0.7433 => 0.7618, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.8172 => 0.8356, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.9449 => 5.0410, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (5.0018 => 5.0837, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (9.4845 => 9.6102, std. dev.: 0.0163) MultiSource/Applications/spiff/spiff: 1.30% (0.7835 => 0.7937, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.1363 => 8.2221, std. dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7591 => 5.8191, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7611, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.66% (26.0924 => 26.7870, std. dev.: 0.0236) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4475, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2365, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.89% (5.2763 => 3.1714, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7082, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7080, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -12.93% (22.1758 => 19.3084, std. dev.: 0.0236) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3549, std. dev.: 0.1075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.99% (3.8922 => 3.7758, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.89% (0.8101 => 0.7948, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (7.9617 => 7.8582, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2373 => 1.1159, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5493, std. dev.: 0.0682) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.80% (8.1563 => 7.9276, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 13:03:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 15:03:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628200329.AFB6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1607?compare_to=1602&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1607, Order: 159357, Start Time: 2012-06-28 17:49:26, End Time: 2012-06-28 20:05:07 To: 1602, Order: 159350, Start Time: 2012-06-28 15:06:52, End Time: 2012-06-28 17:22:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (36 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (856 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.77% (0.3465 => 0.3769, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.76% (0.3446 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.64% (0.3496 => 0.3798, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3469 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3460 => 0.3755, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3488 => 0.3784, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.45% (0.3442 => 0.3733, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.37% (0.3643 => 0.3948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.03% (0.3650 => 0.3943, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.3724 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.60% (0.5826 => 0.6094, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.43% (0.5889 => 0.6150, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 3.88% (0.7171 => 0.7449, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (0.5026 => 0.5207, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (1.6211 => 1.6714, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.5900 => 0.6070, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (3.5627 => 3.6640, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (0.4994 => 0.5132, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (1.3152 => 1.3513, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0673 => 2.1236, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.57% (0.9909 => 1.0164, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.41% (4.2109 => 4.3122, std. dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.01% (2.7292 => 2.7841, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.00% (0.5000 => 0.5100, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.84% (1.0781 => 1.0979, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.80% (23.5202 => 23.9445, std. dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (4.4195 => 4.4991, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (1.9694 => 2.0025, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 1.65% (0.9697 => 0.9857, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (1.9966 => 2.0282, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.43% (4.6177 => 4.6837, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (2.1013 => 2.1308, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.38% (1.8794 => 1.9054, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 1.38% (2.1653 => 2.1951, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.35% (5.5417 => 5.6167, std. dev.: 0.0150) MultiSource/Applications/oggenc/oggenc: 1.16% (1.5932 => 1.6117, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.28% (2.4764 => 2.3704, std. dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: -2.32% (11.9555 => 11.6781, std. dev.: 0.0060) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 13:13:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 15:13:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628201308.5EEDB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1608?compare_to=1605&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1608, Order: 159366, Start Time: 2012-06-28 19:17:50, End Time: 2012-06-28 20:14:44 To: 1605, Order: 159357, Start Time: 2012-06-28 17:54:05, End Time: 2012-06-28 18:50:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (118 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.66% (0.6143 => 0.6245, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 1.43% (0.7405 => 0.7511, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.03% (3.7529 => 3.8289, std. dev.: 0.0265) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2813, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.34% (0.5818 => 0.6245, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.03% (0.5748 => 0.6152, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7061 => 0.7511, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4328 => 0.4582, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.47% (0.4062 => 0.4284, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2782 => 0.2930, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.24% (1.3693 => 1.4410, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.99% (1.9828 => 2.0817, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.7710 => 0.8064, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.37% (3.9660 => 4.1392, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5265 => 0.5487, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.11% (0.3578 => 0.3725, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.06% (0.3789 => 0.3943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.3868 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.03% (0.3646 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.97% (0.3601 => 0.3744, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 3.96% (0.3914 => 0.4069, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.93% (0.3663 => 0.3807, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.90% (0.4003 => 0.4159, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 3.84% (0.3623 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.84% (0.3650 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.6959 => 0.7223, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 3.71% (0.3940 => 0.4086, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.50% (13.8202 => 14.3040, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.9199 => 0.9510, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.13% (1.2292 => 1.2677, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.10% (16.6129 => 17.1273, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.4563 => 1.4985, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.75% (1.3813 => 1.4193, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.3245 => 1.3609, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.73% (1.1364 => 1.1674, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.70% (0.7506 => 0.7709, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1359, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (1.3819 => 1.4182, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.60% (0.5577 => 0.5722, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.59% (1.9270 => 1.9770, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9607, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (7.2180 => 7.3722, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (3.6692 => 3.7457, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 2.03% (2.1791 => 2.2233, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.2842 => 13.5493, std. dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 1.80% (14.8535 => 15.1216, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (6.5754 => 6.6907, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4527, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.4433 => 4.5124, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.29% (3.1889 => 3.2300, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.09% (14.5298 => 14.6886, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2675, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3963, std. dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7285, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7056, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.40% (0.4657 => 0.3940, std. dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9341, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.96% (0.3511 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (6.2785 => 6.2029, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.98% (20.3410 => 18.5146, std. dev.: 0.0291) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5809, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9818, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8472, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2379, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0225) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2100, std. dev.: 0.0318) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8458, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 13:32:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 15:32:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628203205.900DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1609?compare_to=1606&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1609, Order: 159366, Start Time: 2012-06-28 19:32:19, End Time: 2012-06-28 20:33:42 To: 1606, Order: 159357, Start Time: 2012-06-28 18:03:55, End Time: 2012-06-28 19:05:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (37 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 872 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (12.8607 => 13.1569, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.02% (2.3607 => 2.3366, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.91% (10.3673 => 13.1569, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.64% (1.1194 => 1.2609, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.68% (1.7609 => 1.8962, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3543 => 0.3809, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.48% (0.3543 => 0.3808, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.47% (0.3561 => 0.3827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.45% (0.3516 => 0.3778, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.17% (0.3694 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3828 => 0.4094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3927 => 0.4195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.79% (0.3886 => 0.4150, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.10% (2.2022 => 2.3366, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (10.4361 => 10.9706, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (7.0540 => 7.3214, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.71% (0.3177 => 0.3295, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.4879 => 0.5060, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5925 => 0.6128, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.75% (0.4615 => 0.4742, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7326 => 0.7525, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7433 => 0.7633, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.8172 => 0.8356, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.9449 => 5.0244, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (5.0018 => 5.0806, std. dev.: 0.0181) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (9.4845 => 9.6074, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (4.2646 => 4.3126, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (8.1363 => 8.2228, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8185, std. dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6925, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2398, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.28% (1.3045 => 1.3212, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1706, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6867, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.23% (5.3526 => 3.6808, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5419, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -12.86% (22.1758 => 19.3243, std. dev.: 0.0161) SingleSource/UnitTests/Vector/constpool: -5.08% (54.1659 => 51.4137, std. dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.94% (3.8922 => 3.7779, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8101 => 0.7949, std. dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.42% (7.9617 => 7.8483, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2373 => 1.1121, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.59% (19.9488 => 18.6349, std. dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9152, std. dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6833, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 14:36:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 16:36:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628213659.BC7672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1610?compare_to=1608&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1610, Order: 159369, Start Time: 2012-06-28 20:41:49, End Time: 2012-06-28 21:38:34 To: 1608, Order: 159366, Start Time: 2012-06-28 19:17:50, End Time: 2012-06-28 20:14:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.36% (0.7511 => 0.7409, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.7263 => 3.6882, std. dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.82% (2.0176 => 2.2763, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.71% (0.5818 => 0.6150, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: 5.34% (0.5748 => 0.6055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4328 => 0.4555, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.97% (1.3693 => 1.4373, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7061 => 0.7409, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.75% (0.2781 => 0.2913, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (0.7038 => 0.7371, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.7710 => 0.8063, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2760 => 0.2885, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.49% (0.2607 => 0.2724, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.41% (0.2628 => 0.2744, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.38% (0.2765 => 0.2886, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.34% (1.9828 => 2.0689, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2761 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3149 => 0.3283, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.23% (0.2696 => 0.2810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.19% (0.3580 => 0.3730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (3.9660 => 4.1316, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.15% (0.3899 => 0.4061, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.3489 => 0.3631, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5265 => 0.5472, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3192 => 0.3316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.76% (0.4016 => 0.4167, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.59% (0.3534 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.29% (13.8202 => 14.2748, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.4563 => 1.4982, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1167, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.57% (1.3245 => 1.3585, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2292 => 1.2604, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.53% (0.5577 => 0.5718, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4379 => 0.4487, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0217, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (3.8646 => 3.9595, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.45% (1.1061 => 1.1332, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9708, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4124, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (3.6692 => 3.7445, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5438, std. dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.8698 => 0.8866, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.91% (7.2180 => 7.3559, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 1.62% (6.5754 => 6.6817, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0888, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.3801 => 4.4407, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.31% (4.4433 => 4.5017, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2260, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1456, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7118, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7035, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1938, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9527, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.99% (0.3511 => 0.3371, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.41% (6.2785 => 6.1898, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5694, std. dev.: 0.0181) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.36% (1.3780 => 1.3179, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5911, std. dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9790, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8414, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2396, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.18% (0.9692 => 0.9578, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 15:00:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 17:00:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628220043.817C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1611?compare_to=1609&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1611, Order: 159372, Start Time: 2012-06-28 21:00:57, End Time: 2012-06-28 22:02:11 To: 1609, Order: 159366, Start Time: 2012-06-28 19:32:19, End Time: 2012-06-28 20:33:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (814 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.64% (13.1569 => 12.8089, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.55% (10.3673 => 12.8089, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.56% (1.1194 => 1.2600, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.95% (0.3473 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.90% (0.3543 => 0.3823, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (1.7609 => 1.8990, std. dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-2: 7.84% (0.3497 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3543 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.55% (0.3561 => 0.3830, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3694 => 0.3963, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3828 => 0.4094, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3927 => 0.4198, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.90% (0.3886 => 0.4154, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.21% (2.2022 => 2.3389, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (10.4361 => 10.9585, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.98% (0.6030 => 0.6270, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 3.90% (0.5925 => 0.6156, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (7.0540 => 7.3249, std. dev.: 0.0426) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.61% (0.4879 => 0.5055, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.55% (0.7326 => 0.7586, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.8172 => 0.8427, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.96% (0.7433 => 0.7653, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4615 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.9449 => 5.0336, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.79% (5.0018 => 5.0911, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.65% (0.7835 => 0.7964, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.47% (2.0665 => 2.0968, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (9.4845 => 9.6221, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1363 => 8.2417, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.28% (4.2646 => 4.3191, std. dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 1.07% (5.7591 => 5.8207, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7912, std. dev.: 0.0223) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2522, std. dev.: 0.0345) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1623, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6960, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6889, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5362, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.80% (22.1758 => 19.3370, std. dev.: 0.0231) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4177, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.83% (3.8922 => 3.7820, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (0.8101 => 0.7960, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.33% (7.9617 => 7.8556, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1161, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5897, std. dev.: 0.0337) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9121, std. dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 15:46:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 17:46:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120628224617.6B5642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1612?compare_to=1607&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1612, Order: 159369, Start Time: 2012-06-28 20:32:24, End Time: 2012-06-28 22:47:54 To: 1607, Order: 159357, Start Time: 2012-06-28 17:49:26, End Time: 2012-06-28 20:05:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (26 on baseline) Performance Improvements: 4 (2 on baseline) Unchanged Tests: 890 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (2.7841 => 2.7476, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: -1.30% (0.9857 => 0.9729, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -1.01% (1.0164 => 1.0061, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -1.01% (1.6117 => 1.5954, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.73% (0.3446 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3465 => 0.3698, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.72% (0.3496 => 0.3731, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3460 => 0.3689, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.57% (0.3469 => 0.3697, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.54% (0.3442 => 0.3667, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.54% (0.3488 => 0.3716, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.44% (0.3650 => 0.3885, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.42% (0.3643 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.20% (0.3724 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.33% (0.5826 => 0.6020, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (0.5026 => 0.5169, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.5889 => 0.6054, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.66% (0.7171 => 0.7362, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (1.6211 => 1.6615, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.5900 => 0.6041, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (3.5627 => 3.6386, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (1.3152 => 1.3424, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0673 => 2.1026, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 1.68% (4.2109 => 4.2817, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 1.53% (0.9909 => 1.0061, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (1.9694 => 1.9959, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.30% (1.0781 => 1.0921, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (4.4195 => 4.4732, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.05% (23.5202 => 23.7672, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.10% (2.8036 => 2.8345, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.18% (2.4764 => 2.3728, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: -2.91% (11.9555 => 11.6081, std. dev.: 0.0140) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 16:00:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 18:00:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120628230049.2EB682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1613?compare_to=1610&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1613, Order: 159379, Start Time: 2012-06-28 22:05:48, End Time: 2012-06-28 23:02:25 To: 1610, Order: 159369, Start Time: 2012-06-28 20:41:49, End Time: 2012-06-28 21:38:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (739 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.08% (0.3834 => 0.4489, std. dev.: 0.0249) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.45% (2.0176 => 2.2890, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.33% (0.5818 => 0.6128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5748 => 0.6051, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.95% (1.3693 => 1.4371, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.77% (0.7061 => 0.7398, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.7710 => 0.8059, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.48% (3.9660 => 4.1436, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5265 => 0.5491, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (1.9828 => 2.0658, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2726 => 0.2838, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2760 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.09% (0.2765 => 0.2878, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2966 => 0.3084, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.97% (0.3149 => 0.3274, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3580 => 0.3720, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3485 => 0.3618, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.67% (13.8202 => 14.3271, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 3.60% (0.3192 => 0.3307, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3293 => 0.3407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4016 => 0.4155, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3534 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.42% (1.4563 => 1.5061, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3756 => 0.3880, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.23% (0.3868 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.1364 => 1.1705, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.97% (1.1061 => 1.1390, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.2193 => 1.2544, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5577 => 0.5734, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (1.3819 => 1.4207, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.70% (16.6129 => 17.0607, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.69% (1.3813 => 1.4185, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4379 => 0.4495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 2.64% (0.3789 => 0.3889, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.64% (1.9270 => 1.9778, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1172, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: 2.60% (0.7506 => 0.7701, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (3.8646 => 3.9646, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions: 2.58% (0.3914 => 0.4015, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 2.50% (0.4003 => 0.4103, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2292 => 1.2591, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (13.2842 => 13.6045, std. dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (3.6692 => 3.7520, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (7.2180 => 7.3775, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2252, std. dev.: 0.0149) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (6.5754 => 6.7045, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 1.93% (14.8535 => 15.1405, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.3801 => 4.4516, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5154, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2345, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.5298 => 14.6965, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.25% (2.0200 => 2.1866, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: 6.70% (1.2998 => 1.3869, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7364, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6771, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.79% (1.9199 => 1.9735, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6469 => 3.7149, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.89% (22.5627 => 21.0083, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.2785 => 6.1928, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2308 => 1.1022, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5894, std. dev.: 0.0491) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5927, std. dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9791, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.36% (28.2225 => 27.8398, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2125, std. dev.: 0.0285) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2448, std. dev.: 0.0070) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2146, std. dev.: 0.0421) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 16:29:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 18:29:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120628232914.68D6D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1614?compare_to=1611&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1614, Order: 159381, Start Time: 2012-06-28 22:29:34, End Time: 2012-06-28 23:30:51 To: 1611, Order: 159372, Start Time: 2012-06-28 21:00:57, End Time: 2012-06-28 22:02:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 3 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 871 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7586 => 0.7458, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (2.0968 => 2.0750, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.03% (3.7217 => 3.6835, std. dev.: 0.0144) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.47% (10.3673 => 12.9044, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.69% (1.1194 => 1.2615, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9032, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.58% (2.2022 => 2.3472, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3473 => 0.3698, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.46% (0.3543 => 0.3772, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.27% (0.3543 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.23% (0.3516 => 0.3735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.18% (0.3561 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.01% (0.3694 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.83% (0.3927 => 0.4156, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3828 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.66% (0.3886 => 0.4106, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (10.4361 => 11.0069, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.4879 => 0.5076, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (7.0540 => 7.3276, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.81% (0.3177 => 0.3298, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4615 => 0.4755, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.69% (0.8172 => 0.8392, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 2.47% (0.6030 => 0.6179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.35% (0.5925 => 0.6064, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.94% (0.5569 => 0.5677, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 1.80% (0.7326 => 0.7458, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (5.0018 => 5.0908, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.9449 => 5.0326, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (9.4845 => 9.6430, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3144, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.10% (1.5415 => 1.5585, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (8.1363 => 8.2251, std. dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 1.02% (5.7591 => 5.8176, std. dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7531, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7771, std. dev.: 0.0559) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2328, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.80% (5.2763 => 3.1762, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6952, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6832, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5432, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.73% (22.1758 => 19.3525, std. dev.: 0.0208) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3643, std. dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.86% (3.8922 => 3.7810, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8794, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.03% (19.9488 => 18.5473, std. dev.: 0.0394) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9236, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6829, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 17:26:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 19:26:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629002631.E5CD92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1615?compare_to=1613&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1615, Order: 159388, Start Time: 2012-06-28 23:31:31, End Time: 2012-06-29 00:28:07 To: 1613, Order: 159379, Start Time: 2012-06-28 22:05:48, End Time: 2012-06-28 23:02:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.17% (1.3869 => 1.4031, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4328 => 0.4584, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5818 => 0.6162, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.64% (0.5748 => 0.6072, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.37% (0.7038 => 0.7416, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.21% (1.3693 => 1.4407, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.16% (0.7061 => 0.7425, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4062 => 0.4266, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5265 => 0.5509, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.61% (3.9660 => 4.1490, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.45% (0.2966 => 0.3098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2690 => 0.2808, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.7710 => 0.8046, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (1.9828 => 2.0691, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2760 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3899 => 0.4067, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3149 => 0.3283, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3453 => 0.3594, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2696 => 0.2804, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3192 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.77% (13.8202 => 14.3412, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.52% (0.3868 => 0.4004, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4390 => 0.4544, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.4563 => 1.5010, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.1364 => 1.1705, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3245 => 1.3636, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.85% (16.6129 => 17.0865, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1369, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (4.9865 => 5.1221, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (3.8646 => 3.9693, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (0.4379 => 0.4494, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3819 => 1.4175, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9766, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2292 => 1.2606, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 2.49% (0.7506 => 0.7693, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4152, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.2842 => 13.5943, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (7.2180 => 7.3773, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (3.6692 => 3.7482, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2252, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8698 => 0.8871, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.84% (14.8535 => 15.1262, std. dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (6.5754 => 6.6921, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6135 => 0.6240, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.3801 => 4.4511, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.62% (3.1889 => 3.2405, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.4433 => 4.5106, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.1333 => 1.1485, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.08% (1.2749 => 1.2887, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.5298 => 14.6819, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 26.11% (1.8175 => 2.2920, std. dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.95% (1.2998 => 1.4031, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7329, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7080, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0383, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.2785 => 6.1942, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.43% (1.2308 => 1.1147, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.33% (20.3410 => 18.4431, std. dev.: 0.0603) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5945, std. dev.: 0.0242) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.07% (6.6320 => 6.4949, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9818, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8417, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2168, std. dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0325) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 17:57:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 19:57:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629005746.A3FEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1616?compare_to=1614&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1616, Order: 159388, Start Time: 2012-06-28 23:58:09, End Time: 2012-06-29 00:59:23 To: 1614, Order: 159381, Start Time: 2012-06-28 22:29:34, End Time: 2012-06-28 23:30:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.83% (10.3673 => 12.9416, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.11% (1.1194 => 1.2661, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.87% (1.7609 => 1.8994, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.36% (2.2022 => 2.3423, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 6.10% (0.3473 => 0.3685, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.04% (0.3543 => 0.3757, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.77% (0.3516 => 0.3719, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3543 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3561 => 0.3766, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.63% (0.3694 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.41% (0.3828 => 0.4035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.40% (0.3886 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.32% (0.3927 => 0.4136, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9745, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (7.0540 => 7.3384, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.03% (0.3177 => 0.3305, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.6030 => 0.6232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5925 => 0.6121, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7433 => 0.7644, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.8172 => 0.8391, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 2.58% (0.7326 => 0.7515, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (5.0018 => 5.0942, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (4.9449 => 5.0335, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (9.4845 => 9.6446, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (8.1363 => 8.2358, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8272, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (2.0665 => 2.0906, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.14% (4.2646 => 4.3133, std. dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7517, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7753, std. dev.: 0.0407) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2374, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6863, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.76% (5.2763 => 3.1787, std. dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6991, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6880, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5538, std. dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -12.76% (22.1758 => 19.3470, std. dev.: 0.0223) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4682, std. dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.83% (3.8922 => 3.7822, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.63% (0.8101 => 0.7969, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.28% (7.9617 => 7.8598, std. dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2373 => 1.1102, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5679, std. dev.: 0.0469) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9185, std. dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6867, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 18:28:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 20:28:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629012858.8F3262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1617?compare_to=1612&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1617, Order: 159385, Start Time: 2012-06-28 23:14:59, End Time: 2012-06-29 01:30:35 To: 1612, Order: 159369, Start Time: 2012-06-28 20:32:24, End Time: 2012-06-28 22:47:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (25 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.02% (2.0393 => 2.0805, std. dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3496 => 0.3734, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3465 => 0.3693, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.56% (0.3446 => 0.3672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.51% (0.3488 => 0.3715, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3442 => 0.3666, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.47% (0.3460 => 0.3684, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.37% (0.3469 => 0.3690, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3643 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.16% (0.3650 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.99% (0.3724 => 0.3947, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 3.48% (0.5826 => 0.6029, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.24% (0.5889 => 0.6080, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (0.5026 => 0.5151, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 2.47% (0.7171 => 0.7348, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (0.4361 => 0.4467, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (1.6211 => 1.6604, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.5900 => 0.6024, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.89% (3.5627 => 3.6301, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.79% (4.2109 => 4.2862, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (1.3152 => 1.3374, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0673 => 2.0972, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.44% (0.9909 => 1.0052, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (4.4195 => 4.4752, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.20% (1.0781 => 1.0910, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.01% (1.8794 => 1.8984, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.09% (2.4764 => 2.3752, std. dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: -2.70% (11.9555 => 11.6327, std. dev.: 0.0126) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 18:50:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 20:50:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629015023.3F2DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1618?compare_to=1615&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1618, Order: 159394, Start Time: 2012-06-29 00:55:23, End Time: 2012-06-29 01:51:59 To: 1615, Order: 159388, Start Time: 2012-06-28 23:31:31, End Time: 2012-06-29 00:28:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 2.68% (0.3874 => 0.3978, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.41% (2.2920 => 2.2596, std. dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.69% (2.0176 => 2.2939, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.5818 => 0.6218, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5748 => 0.6127, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.03% (0.7061 => 0.7487, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4415, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.16% (0.3022 => 0.3178, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.91% (1.9828 => 2.0802, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.7710 => 0.8086, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.81% (0.5265 => 0.5518, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.76% (0.3489 => 0.3655, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.73% (3.9660 => 4.1534, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.3868 => 0.4024, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3735, std. dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.2193 => 1.2619, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 3.24% (0.3578 => 0.3694, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.20% (0.4003 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5028, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.18% (1.1364 => 1.1725, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 3.17% (0.3914 => 0.4038, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5577 => 0.5753, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 3.15% (0.3646 => 0.3761, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.14% (0.3789 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.11% (0.3601 => 0.3713, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.03% (1.2292 => 1.2665, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.99% (0.3650 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 2.97% (0.3940 => 0.4057, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.92% (16.6129 => 17.0972, std. dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: 2.90% (0.3623 => 0.3728, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4379 => 0.4505, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.84% (1.1061 => 1.1375, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9734, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.75% (4.9865 => 5.1236, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (1.3813 => 1.4192, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.68% (0.7506 => 0.7707, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.68% (1.3819 => 1.4189, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.67% (1.9270 => 1.9784, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (13.2842 => 13.6207, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8698 => 0.8906, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (7.2180 => 7.3887, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.32% (3.6692 => 3.7545, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2261, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.98% (14.8535 => 15.1477, std. dev.: 0.0187) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (6.5754 => 6.7023, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.80% (4.3801 => 4.4590, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2424, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (4.4433 => 4.5160, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1498, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.28% (14.5298 => 14.7163, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.97% (1.2998 => 1.3904, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.19% (7.4271 => 7.7380, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5089 => 1.5373, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7085, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.58% (0.4657 => 0.3978, std. dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.5627 => 21.0424, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3511 => 0.3365, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5738, std. dev.: 0.0425) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6020, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9793, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8443, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std. dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0246) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2127, std. dev.: 0.0337) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 19:26:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 21:26:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629022615.1F7592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1619?compare_to=1616&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1619, Order: 159401, Start Time: 2012-06-29 01:26:43, End Time: 2012-06-29 02:27:51 To: 1616, Order: 159388, Start Time: 2012-06-28 23:58:09, End Time: 2012-06-29 00:59:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (819 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (12.9416 => 13.3021, std. dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.31% (10.3673 => 13.3021, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.87% (1.1194 => 1.2635, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (1.7609 => 1.9051, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.31% (0.3473 => 0.3692, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.17% (2.2022 => 2.3380, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 6.10% (0.3543 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.09% (0.3497 => 0.3710, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.04% (0.3543 => 0.3757, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 6.04% (0.3561 => 0.3776, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.00% (0.3516 => 0.3727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.85% (0.3694 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.58% (0.3927 => 0.4146, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.56% (0.3828 => 0.4041, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.53% (0.3886 => 0.4101, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (10.4361 => 11.0052, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.96% (0.4879 => 0.5072, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.68% (0.3177 => 0.3294, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (7.0540 => 7.3092, std. dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 2.41% (0.5925 => 0.6068, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.35% (0.6030 => 0.6172, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.8172 => 0.8327, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (4.9449 => 5.0275, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 1.67% (0.7326 => 0.7448, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (5.0018 => 5.0812, std. dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (9.4845 => 9.6263, std. dev.: 0.0150) MultiSource/Applications/spiff/spiff: 1.37% (0.7835 => 0.7942, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (4.2646 => 4.3121, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.1363 => 8.2206, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.7984, std. dev.: 0.0405) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2448, std. dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.80% (5.2763 => 3.1761, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6885, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.32% (5.3526 => 3.6762, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5469, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.87% (22.1758 => 19.3219, std. dev.: 0.0251) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3397, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.78% (3.8922 => 3.7839, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.01% (0.8101 => 0.7938, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (7.9617 => 7.8327, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.97% (1.2373 => 1.1140, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.21% (19.9488 => 18.5095, std. dev.: 0.0664) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9155, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6824, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 20:14:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 22:14:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629031405.3ABBA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1620?compare_to=1618&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1620, Order: 159405, Start Time: 2012-06-29 02:19:06, End Time: 2012-06-29 03:15:41 To: 1618, Order: 159394, Start Time: 2012-06-29 00:55:23, End Time: 2012-06-29 01:51:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.04% (33.3431 => 32.9978, std. dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.88% (0.5818 => 0.6160, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5748 => 0.6074, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7061 => 0.7435, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.89% (1.3693 => 1.4363, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7038 => 0.7380, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5265 => 0.5505, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (3.9660 => 4.1403, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.38% (0.7710 => 0.8048, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2596 => 0.2709, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2782 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.09% (0.2937 => 0.3057, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.09% (1.9828 => 2.0638, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2966 => 0.3086, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2628 => 0.2732, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2765 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3489 => 0.3622, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.80% (0.3580 => 0.3716, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3107 => 0.3225, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.72% (0.3899 => 0.4044, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (0.3485 => 0.3610, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.47% (13.8202 => 14.2995, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.4016 => 0.4152, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3756 => 0.3880, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.2193 => 1.2595, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (0.3293 => 0.3400, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.23% (0.3868 => 0.3993, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4390 => 0.4521, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3630, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0445, std. dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (3.8646 => 3.9644, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 2.54% (1.9270 => 1.9759, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.53% (0.4379 => 0.4490, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.52% (1.1061 => 1.1340, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.50% (0.7506 => 0.7694, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 2.50% (0.4003 => 0.4103, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.46% (1.2292 => 1.2594, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4145, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (4.9865 => 5.1024, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.3819 => 1.4137, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.2842 => 13.5636, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.10% (3.6692 => 3.7462, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.99% (7.2180 => 7.3617, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 1.88% (2.1791 => 2.2200, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.75% (14.8535 => 15.1130, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8698 => 0.8849, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.66% (6.5754 => 6.6847, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (4.3801 => 4.4454, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (4.4433 => 4.5053, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 1.26% (3.1889 => 3.2290, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1333 => 1.1470, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.5298 => 14.6807, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7214, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: 3.75% (1.9144 => 1.9861, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7094, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.29% (0.4657 => 0.3852, std. dev.: 0.0163) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9375, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.24% (0.3511 => 0.3362, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.8818 => 0.8561, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.2785 => 6.1868, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2308 => 1.0976, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.02% (20.3410 => 18.5071, std. dev.: 0.0499) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5970, std. dev.: 0.0173) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4978, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8471, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2484, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2184, std. dev.: 0.0275) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1936, std. dev.: 0.0414) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2435, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 20:54:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 22:54:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629035455.7EBF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1621?compare_to=1619&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1621, Order: 159405, Start Time: 2012-06-29 02:55:11, End Time: 2012-06-29 03:56:33 To: 1619, Order: 159401, Start Time: 2012-06-29 01:26:43, End Time: 2012-06-29 02:27:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.03% (11.0052 => 10.8920, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.41% (10.3673 => 13.2085, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.23% (1.1194 => 1.2675, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.42% (1.7609 => 1.9092, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3543 => 0.3808, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 7.14% (0.3473 => 0.3721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.89% (0.3497 => 0.3738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3543 => 0.3784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.71% (0.3561 => 0.3800, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.59% (2.2022 => 2.3474, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3694 => 0.3935, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.50% (0.3828 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3927 => 0.4176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.25% (0.3886 => 0.4129, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.37% (10.4361 => 10.8920, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.93% (0.3177 => 0.3302, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3234, std. dev.: 0.0099) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5925 => 0.6121, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.27% (0.6030 => 0.6227, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.17% (0.3282 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.8172 => 0.8418, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7433 => 0.7646, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 2.46% (0.7326 => 0.7506, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.44% (0.5569 => 0.5705, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.85% (4.9449 => 5.0364, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (5.0018 => 5.0937, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (9.4845 => 9.6413, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (4.2646 => 4.3210, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (8.1363 => 8.2426, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.02% (1.1642 => 1.1761, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7973, std. dev.: 0.0434) MultiSource/Applications/minisat/minisat: 1.59% (9.1159 => 9.2604, std. dev.: 0.0212) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.88% (5.2763 => 3.1722, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.35% (5.3855 => 3.6970, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.05% (5.3526 => 3.6907, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5434, std. dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: -12.60% (22.1758 => 19.3818, std. dev.: 0.0206) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3090, std. dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.54% (3.8922 => 3.7935, std. dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.78% (0.8101 => 0.7957, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (7.9617 => 7.8686, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2373 => 1.1079, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.16% (19.9488 => 18.5207, std. dev.: 0.0657) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9270, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6899, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0853, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 21:11:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 23:11:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629041138.3AAFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1622?compare_to=1617&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1622, Order: 159405, Start Time: 2012-06-29 01:57:44, End Time: 2012-06-29 04:13:14 To: 1617, Order: 159385, Start Time: 2012-06-28 23:14:59, End Time: 2012-06-29 01:30:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 6.97% (0.3488 => 0.3731, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.85% (0.3446 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.84% (0.3465 => 0.3702, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.76% (0.3460 => 0.3694, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 6.75% (0.3496 => 0.3732, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.71% (0.3442 => 0.3673, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.70% (0.3643 => 0.3887, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3469 => 0.3701, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.44% (0.3650 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.28% (0.3724 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.30% (0.5826 => 0.6018, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.5900 => 0.6084, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 3.06% (0.5889 => 0.6069, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (1.6211 => 1.6641, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.61% (0.7171 => 0.7358, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (0.5026 => 0.5155, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (0.4361 => 0.4470, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (0.4994 => 0.5110, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (3.5627 => 3.6442, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (1.3152 => 1.3442, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.85% (4.2109 => 4.2888, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (4.4195 => 4.4793, std. dev.: 0.0131) MultiSource/Applications/hexxagon/hexxagon: 1.30% (0.9909 => 1.0038, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.26% (1.0781 => 1.0917, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (1.9694 => 1.9921, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (1.9966 => 2.0188, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.03% (1.8794 => 1.8988, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.29% (2.4764 => 2.3702, std. dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: -2.70% (11.9555 => 11.6328, std. dev.: 0.0065) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 21:52:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 28 Jun 2012 23:52:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629045230.DCDA22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1623?compare_to=1620&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1623, Order: 159406, Start Time: 2012-06-29 03:57:31, End Time: 2012-06-29 04:54:06 To: 1620, Order: 159405, Start Time: 2012-06-29 02:19:06, End Time: 2012-06-29 03:15:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.62% (3.8852 => 3.7836, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.20% (2.0176 => 2.2840, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.5818 => 0.6161, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.71% (0.5748 => 0.6076, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7061 => 0.7433, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4328 => 0.4547, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.93% (0.7038 => 0.7385, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5265 => 0.5505, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.41% (3.9660 => 4.1410, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2596 => 0.2709, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.7710 => 0.8038, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2655 => 0.2762, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.98% (0.2937 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.96% (1.9828 => 2.0613, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3580 => 0.3720, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2765 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2726 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3107 => 0.3225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.3899 => 0.4047, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3489 => 0.3620, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.69% (0.6959 => 0.7216, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3485 => 0.3608, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.51% (0.4016 => 0.4157, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3007, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9199 => 0.9518, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.38% (0.3756 => 0.3883, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3534 => 0.3650, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.2193 => 1.2588, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5577 => 0.5742, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.4563 => 1.4988, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (1.1364 => 1.1680, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 2.68% (0.3914 => 0.4019, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (3.8646 => 3.9643, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 2.55% (0.4003 => 0.4105, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.53% (0.4379 => 0.4490, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.52% (16.6129 => 17.0320, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.51% (1.3819 => 1.4166, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.49% (1.9270 => 1.9750, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4155, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.42% (0.7506 => 0.7688, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.30% (4.9865 => 5.1013, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2292 => 1.2570, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.7460 => 0.7622, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (13.2842 => 13.5596, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (7.2180 => 7.3675, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (3.6692 => 3.7439, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.81% (14.8535 => 15.1228, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 1.78% (2.1791 => 2.2178, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.6135 => 0.6243, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.8698 => 0.8847, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (6.5754 => 6.6870, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.50% (4.3801 => 4.4459, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (4.4433 => 4.5049, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1333 => 1.1476, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2284, std. dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6769, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 25.19% (1.8175 => 2.2754, std. dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.27% (1.2998 => 1.3943, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7160, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6807, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6469 => 3.7155, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std. dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9483, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.24% (0.3511 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.42% (6.2785 => 6.1896, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0998, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.95% (20.3410 => 18.5207, std. dev.: 0.0675) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5913, std. dev.: 0.0185) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5103, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9830, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8442, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2140, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0151) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0146) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 22:23:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 00:23:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629052335.A184A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1624?compare_to=1621&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1624, Order: 159408, Start Time: 2012-06-29 04:23:51, End Time: 2012-06-29 05:25:12 To: 1621, Order: 159405, Start Time: 2012-06-29 02:55:11, End Time: 2012-06-29 03:56:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.09% (13.2085 => 13.0641, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.01% (10.3673 => 13.0641, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.31% (1.1194 => 1.2684, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.7609 => 1.9078, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.06% (2.2022 => 2.3577, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.65% (0.3473 => 0.3704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3543 => 0.3776, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3543 => 0.3774, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.41% (0.3497 => 0.3721, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.37% (0.3516 => 0.3740, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.35% (0.3561 => 0.3787, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.09% (0.3694 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.93% (0.3828 => 0.4055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.89% (0.3886 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.81% (0.3927 => 0.4155, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (10.4361 => 10.9077, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (7.0540 => 7.3464, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.4879 => 0.5076, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.97% (0.3177 => 0.3303, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.35% (0.3282 => 0.3392, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.05% (0.8172 => 0.8421, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4615 => 0.4749, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 2.70% (0.6030 => 0.6193, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 2.60% (0.5925 => 0.6079, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7326 => 0.7478, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.9449 => 5.0425, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (5.0018 => 5.0907, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (9.4845 => 9.6413, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.53% (0.7835 => 0.7955, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.1363 => 8.2365, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (4.2646 => 4.3156, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7591 => 5.8190, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7535, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.77% (26.0924 => 26.8153, std. dev.: 0.0279) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5369, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.81% (5.2763 => 3.1758, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7123, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7036, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5493, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.56% (22.1758 => 19.3913, std. dev.: 0.0317) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.4989, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.71% (3.8922 => 3.7869, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.79% (0.8101 => 0.7956, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (7.9617 => 7.8805, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2373 => 1.1103, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.00% (19.9488 => 18.5518, std. dev.: 0.0638) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9153, std. dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6898, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0831, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 23:16:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 01:16:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629061616.A5FEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1625?compare_to=1623&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1625, Order: 159409, Start Time: 2012-06-29 05:21:14, End Time: 2012-06-29 06:17:53 To: 1623, Order: 159406, Start Time: 2012-06-29 03:57:31, End Time: 2012-06-29 04:54:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (101 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (750 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.75% (7.9350 => 8.0735, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.0998 => 1.1124, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.5818 => 0.6142, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5748 => 0.6051, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7038 => 0.7391, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.95% (1.3693 => 1.4371, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (0.4328 => 0.4540, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7061 => 0.7406, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.31% (3.9660 => 4.1368, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.26% (0.4062 => 0.4235, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.7710 => 0.8033, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.87% (0.3022 => 0.3139, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.85% (0.2781 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2782 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.66% (1.9828 => 2.0554, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2760 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2966 => 0.3074, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3489 => 0.3612, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.52% (13.8202 => 14.3061, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3899 => 0.4036, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3580 => 0.3704, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3107 => 0.3214, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.2937 => 0.3038, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3453 => 0.3570, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3485 => 0.3601, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.27% (0.3149 => 0.3252, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2574, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.11% (0.4016 => 0.4141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3534 => 0.3643, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3756 => 0.3869, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4390 => 0.4513, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3615, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.71% (0.3868 => 0.3973, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9678, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 2.63% (0.3914 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.62% (0.4003 => 0.4108, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.54% (4.9865 => 5.1134, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9751, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.44% (0.7506 => 0.7689, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0171, std. dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.42% (0.4379 => 0.4485, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.27% (1.3813 => 1.4127, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2292 => 1.2549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.3819 => 1.4105, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.2842 => 13.5571, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (7.2180 => 7.3608, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7393, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.88% (2.1791 => 2.2200, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1070, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6826, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6135 => 0.6235, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8698 => 0.8838, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.42% (4.3801 => 4.4422, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.33% (4.4433 => 4.5024, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.21% (3.1889 => 3.2274, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6769, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 26.48% (1.8175 => 2.2988, std. dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.88% (1.2998 => 1.4022, std. dev.: 0.0085) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7206, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (3.6469 => 3.7024, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1935, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9527, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9456, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.49% (6.2785 => 6.1848, std. dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: -1.13% (33.2944 => 32.9184, std. dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6083, std. dev.: 0.0405) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6079, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2470, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9820, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8450, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std. dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2352, std. dev.: 0.0298) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 23:52:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 01:52:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629065222.3EEC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1626?compare_to=1624&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1626, Order: 159409, Start Time: 2012-06-29 05:52:28, End Time: 2012-06-29 06:53:56 To: 1624, Order: 159408, Start Time: 2012-06-29 04:23:51, End Time: 2012-06-29 05:25:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.99% (10.3673 => 13.0614, std. dev.: 0.0368) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.55% (1.1194 => 1.2711, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (1.7609 => 1.9085, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.06% (2.2022 => 2.3577, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-4: 6.60% (0.3543 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.59% (0.3473 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.52% (0.3497 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.49% (0.3561 => 0.3792, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.41% (0.3543 => 0.3770, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.37% (0.3516 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.23% (0.3694 => 0.3924, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 6.01% (0.3828 => 0.4058, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 5.92% (0.3886 => 0.4116, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 5.88% (0.3927 => 0.4158, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.2065 => 0.2166, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9022, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (7.0540 => 7.3549, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.87% (0.3177 => 0.3300, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.74% (0.6030 => 0.6195, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7433 => 0.7633, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 2.62% (0.5925 => 0.6080, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 2.46% (0.7326 => 0.7506, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.9449 => 5.0464, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.05% (0.5569 => 0.5683, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (5.0018 => 5.0941, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (9.4845 => 9.6381, std. dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3180, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.1363 => 8.2360, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.08% (1.5415 => 1.5582, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.01% (5.7591 => 5.8172, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8171, std. dev.: 0.0270) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5379, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4475, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6911, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1739, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7151, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7068, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5534, std. dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: -12.56% (22.1758 => 19.3898, std. dev.: 0.0225) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5321, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.67% (3.8922 => 3.7884, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (0.8101 => 0.7960, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2373 => 1.1167, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5752, std. dev.: 0.0699) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9216, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6933, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0816, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jun 28 23:54:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 01:54:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629065437.06F7A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1627?compare_to=1622&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1627, Order: 159408, Start Time: 2012-06-29 04:40:28, End Time: 2012-06-29 06:56:14 To: 1622, Order: 159405, Start Time: 2012-06-29 01:57:44, End Time: 2012-06-29 04:13:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (23 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 6.33% (0.3460 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.26% (0.3496 => 0.3715, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.26% (0.3465 => 0.3682, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3488 => 0.3706, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 6.22% (0.3442 => 0.3656, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.21% (0.3446 => 0.3660, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.20% (0.3643 => 0.3869, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 6.08% (0.3469 => 0.3680, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.84% (0.3650 => 0.3863, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.83% (0.3724 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.21% (0.5826 => 0.6013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.89% (0.5889 => 0.6059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.57% (0.7171 => 0.7355, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (1.6211 => 1.6597, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (0.5026 => 0.5134, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (3.5627 => 3.6291, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0673 => 2.1056, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.71% (0.9909 => 1.0078, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (1.3152 => 1.3334, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 1.37% (4.2109 => 4.2686, std. dev.: 0.0080) MultiSource/Applications/hbd/hbd: 1.17% (0.9697 => 0.9810, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.03% (23.5202 => 23.7635, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.24% (2.4764 => 2.3714, std. dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: -2.84% (11.9555 => 11.6155, std. dev.: 0.0197) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 00:42:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 02:42:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629074236.CF88D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1628?compare_to=1625&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1628, Order: 159410, Start Time: 2012-06-29 06:44:55, End Time: 2012-06-29 07:44:12 To: 1625, Order: 159409, Start Time: 2012-06-29 05:21:14, End Time: 2012-06-29 06:17:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (88 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (767 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.55% (0.5818 => 0.6141, std. dev.: 0.0111) MultiSource/Applications/hbd/hbd: 5.01% (1.3693 => 1.4379, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.01% (0.7710 => 0.8096, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.71% (0.4328 => 0.4532, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5265 => 0.5506, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4062 => 0.4246, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.34% (3.9660 => 4.1381, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2782 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.73% (0.2765 => 0.2868, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.3489 => 0.3615, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.58% (13.8202 => 14.3144, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.2937 => 0.3039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3107 => 0.3212, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.36% (0.4016 => 0.4151, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3453 => 0.3568, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3192 => 0.3296, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.24% (0.3485 => 0.3598, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.2193 => 1.2587, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.21% (0.3149 => 0.3250, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3534 => 0.3644, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (1.4563 => 1.4991, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3756 => 0.3865, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (1.1364 => 1.1686, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3245 => 1.3614, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3868 => 0.3975, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (3.8646 => 3.9638, std. dev.: 0.0063) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.51% (4.9865 => 5.1116, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 2.50% (16.6129 => 17.0280, std. dev.: 0.0102) MultiSource/Applications/treecc/treecc: 2.48% (1.9270 => 1.9748, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.07% (1.2292 => 1.2546, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2237, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (13.2842 => 13.5544, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (3.6692 => 3.7412, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (7.2180 => 7.3594, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.67% (14.8535 => 15.1014, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.8698 => 0.8841, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6826, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.44% (4.3801 => 4.4433, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 1.44% (3.1889 => 3.2347, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (4.4433 => 4.5042, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.23% (1.1333 => 1.1472, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.5298 => 14.6860, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 25.51% (1.8175 => 2.2811, std. dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.66% (2.0200 => 2.1949, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3967, std. dev.: 0.0149) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0300) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 2.75% (3.7731 => 3.8768, std. dev.: 0.0399) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9889, std. dev.: 0.4137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.33% (0.3511 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.52% (6.2785 => 6.1833, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.35% (20.3410 => 18.4390, std. dev.: 0.0778) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3780 => 1.3214, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5959, std. dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9786, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8421, std. dev.: 0.1082) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2194, std. dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2510, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2138, std. dev.: 0.0294) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 01:24:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 03:24:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629082453.825972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1629?compare_to=1626&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1629, Order: 159410, Start Time: 2012-06-29 07:25:01, End Time: 2012-06-29 08:26:29 To: 1626, Order: 159409, Start Time: 2012-06-29 05:52:28, End Time: 2012-06-29 06:53:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.68% (2.3167 => 2.2778, std. dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.98% (10.3673 => 13.0607, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.33% (1.1194 => 1.2686, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.42% (1.7609 => 1.9091, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3573, std. dev.: 0.0111) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3473 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.44% (0.3543 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.40% (0.3561 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3497 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.37% (0.3516 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.32% (0.3543 => 0.3767, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 6.15% (0.3694 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.93% (0.3828 => 0.4055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.87% (0.3886 => 0.4114, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.81% (0.3927 => 0.4155, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9027, std. dev.: 0.0233) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (7.0540 => 7.3445, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.4879 => 0.5078, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.93% (0.3177 => 0.3302, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.35% (0.3282 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7433 => 0.7633, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 2.65% (0.6030 => 0.6190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.58% (0.5925 => 0.6078, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.8172 => 0.8339, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 1.87% (0.7326 => 0.7463, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.9449 => 5.0361, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.80% (0.5569 => 0.5669, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (5.0018 => 5.0893, std. dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (9.4845 => 9.6361, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.1363 => 8.2336, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.18% (4.2646 => 4.3148, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.58% (26.0924 => 26.7662, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2318, std. dev.: 0.0405) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.83% (5.2763 => 3.1746, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7112, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7034, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: -12.47% (22.1758 => 19.4099, std. dev.: 0.0352) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5128, std. dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.70% (3.8922 => 3.7872, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.83% (0.8101 => 0.7953, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (7.9617 => 7.8731, std. dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5960, std. dev.: 0.0276) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9227, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6938, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0814, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 02:06:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 04:06:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629090635.A0D9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1630?compare_to=1628&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1630, Order: 159412, Start Time: 2012-06-29 08:11:34, End Time: 2012-06-29 09:08:12 To: 1628, Order: 159410, Start Time: 2012-06-29 06:44:55, End Time: 2012-06-29 07:44:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.82% (3.8768 => 3.7675, std. dev.: 0.0398) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2774, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.5818 => 0.6146, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5748 => 0.6051, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.07% (1.3693 => 1.4387, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 4.90% (0.7061 => 0.7407, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.4328 => 0.4534, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5265 => 0.5507, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.7710 => 0.8063, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4062 => 0.4241, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.38% (3.9660 => 4.1399, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.04% (0.3022 => 0.3144, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.95% (0.2607 => 0.2710, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2781 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.92% (0.2782 => 0.2891, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2760 => 0.2867, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (1.9828 => 2.0582, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.6959 => 0.7223, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2655 => 0.2755, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.3580 => 0.3713, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.2937 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.2966 => 0.3075, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2765 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3489 => 0.3616, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.62% (0.2761 => 0.2861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.62% (0.3899 => 0.4040, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.52% (13.8202 => 14.3064, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 3.48% (0.3453 => 0.3573, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.47% (0.3485 => 0.3606, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9199 => 0.9518, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3107 => 0.3213, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.4016 => 0.4150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3192 => 0.3297, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3756 => 0.3875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.14% (0.3534 => 0.3645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5577 => 0.5749, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.4563 => 1.4998, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.3245 => 1.3640, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.97% (0.3868 => 0.3983, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4390 => 0.4517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 2.85% (0.3578 => 0.3680, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 2.83% (0.3646 => 0.3749, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1685, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (3.8646 => 3.9715, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 2.70% (0.4003 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 2.69% (0.3789 => 0.3891, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1358, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 2.66% (0.3914 => 0.4018, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.61% (1.9270 => 1.9773, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4379 => 0.4493, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.55% (16.6129 => 17.0365, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (4.9865 => 5.1090, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.31% (1.3819 => 1.4138, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.18% (1.3813 => 1.4114, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.17% (1.2292 => 1.2559, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (7.2180 => 7.3726, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5615, std. dev.: 0.0141) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (3.6692 => 3.7428, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.91% (14.8535 => 15.1375, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.65% (6.5754 => 6.6837, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (0.8698 => 0.8836, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.3801 => 4.4463, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.46% (4.4433 => 4.5082, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.5298 => 14.6808, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.08% (0.1824 => 0.3540, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0475) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1880, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 7.73% (1.2998 => 1.4003, std. dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7420, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7093, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9451, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3511 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (6.2785 => 6.1907, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.09% (33.2944 => 32.9310, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2308 => 1.1051, std. dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.94% (20.3410 => 18.5218, std. dev.: 0.0641) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5991, std. dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8588, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2613, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9813, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8442, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2108, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2421, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2270, std. dev.: 0.0539) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 02:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 04:43:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629094336.DB1932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1631?compare_to=1627&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1631, Order: 159410, Start Time: 2012-06-29 07:29:38, End Time: 2012-06-29 09:45:13 To: 1627, Order: 159408, Start Time: 2012-06-29 04:40:28, End Time: 2012-06-29 06:56:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (23 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 6.32% (0.3465 => 0.3684, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.27% (0.3446 => 0.3662, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.24% (0.3496 => 0.3714, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.21% (0.3460 => 0.3675, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.14% (0.3488 => 0.3702, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 6.10% (0.3442 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.05% (0.3469 => 0.3679, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3643 => 0.3861, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.81% (0.3650 => 0.3862, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.3724 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5826 => 0.6019, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 2.87% (0.5889 => 0.6058, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.5900 => 0.6053, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.43% (1.6211 => 1.6605, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 1.88% (0.7171 => 0.7306, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.88% (2.0673 => 2.1061, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.87% (0.9909 => 1.0094, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.81% (3.5627 => 3.6273, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.55% (1.3152 => 1.3356, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.53% (4.2109 => 4.2755, std. dev.: 0.0086) MultiSource/Applications/hbd/hbd: 1.53% (0.9697 => 0.9845, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.01% (23.5202 => 23.7571, std. dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.99% (2.4764 => 2.3777, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -2.76% (11.9555 => 11.6261, std. dev.: 0.0140) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 02:53:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 04:53:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629095318.E4F3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1632?compare_to=1629&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1632, Order: 159412, Start Time: 2012-06-29 08:53:48, End Time: 2012-06-29 09:54:56 To: 1629, Order: 159410, Start Time: 2012-06-29 07:25:01, End Time: 2012-06-29 08:26:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (38 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.71% (10.3673 => 13.0330, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.71% (1.1194 => 1.2729, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.59% (1.7609 => 1.9122, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.14% (2.2022 => 2.3594, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3473 => 0.3698, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.29% (0.3497 => 0.3717, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.27% (0.3543 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3543 => 0.3765, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.23% (0.3516 => 0.3735, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.21% (0.3561 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.93% (0.3694 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.89% (0.3886 => 0.4115, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.77% (0.3828 => 0.4049, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.70% (0.3927 => 0.4151, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (10.4361 => 10.9073, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3546, std. dev.: 0.0285) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.12% (0.3177 => 0.3308, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.75% (0.3282 => 0.3405, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.6030 => 0.6199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.63% (0.5925 => 0.6081, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.60% (0.7433 => 0.7626, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.8172 => 0.8343, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 1.88% (0.7326 => 0.7464, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5569 => 0.5671, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.9449 => 5.0343, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (5.0018 => 5.0903, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (9.4845 => 9.6315, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.19% (8.1363 => 8.2334, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.2646 => 4.3135, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 1.06% (5.7591 => 5.8200, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std. dev.: 0.0067) MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7576, std. dev.: 0.0539) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (1.5086 => 1.5383, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2464, std. dev.: 0.0268) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.78% (5.2763 => 3.1775, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7193, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7114, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.65% (2.9384 => 2.5667, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -12.58% (22.1758 => 19.3857, std. dev.: 0.0251) SingleSource/UnitTests/Vector/constpool: -4.83% (54.1659 => 51.5517, std. dev.: 0.0370) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.59% (3.8922 => 3.7912, std. dev.: 0.0226) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.8101 => 0.7955, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (7.9617 => 7.8742, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2373 => 1.1146, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5286, std. dev.: 0.1186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9147, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6905, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0867, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 03:32:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 05:32:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629103247.3E7E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1633?compare_to=1630&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1633, Order: 159417, Start Time: 2012-06-29 09:37:39, End Time: 2012-06-29 10:34:23 To: 1630, Order: 159412, Start Time: 2012-06-29 08:11:34, End Time: 2012-06-29 09:08:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (747 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2717, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.40% (0.5818 => 0.6132, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.17% (0.5748 => 0.6045, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.04% (0.7038 => 0.7393, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 4.95% (1.3693 => 1.4371, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.79% (0.7061 => 0.7399, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.71% (0.4328 => 0.4532, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.29% (3.9660 => 4.1363, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.7710 => 0.8035, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2781 => 0.2890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2760 => 0.2868, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.90% (0.3022 => 0.3140, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.81% (0.2782 => 0.2888, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.77% (0.3899 => 0.4046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.2937 => 0.3045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2765 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (1.9828 => 2.0545, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.3489 => 0.3615, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.61% (0.2966 => 0.3073, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.60% (0.3580 => 0.3709, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.45% (13.8202 => 14.2968, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3107 => 0.3213, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3149 => 0.3256, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3453 => 0.3568, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3485 => 0.3601, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.16% (0.3192 => 0.3293, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4016 => 0.4142, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.06% (0.3534 => 0.3642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3293 => 0.3393, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3756 => 0.3869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.2193 => 1.2558, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/moments: 2.82% (0.3868 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.80% (1.3245 => 1.3616, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.4563 => 1.4970, std. dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4390 => 0.4511, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 2.63% (0.3914 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.60% (0.4003 => 0.4107, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (3.8646 => 3.9641, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4379 => 0.4489, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.44% (4.9865 => 5.1081, std. dev.: 0.0183) MultiSource/Applications/spiff/spiff: 2.42% (0.7506 => 0.7688, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.41% (16.6129 => 17.0126, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1326, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.39% (1.9270 => 1.9730, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.3813 => 1.4110, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4107, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5578, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2292 => 1.2545, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.00% (7.2180 => 7.3622, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2188, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7350, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.72% (14.8535 => 15.1091, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (6.5754 => 6.6780, std. dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.8698 => 0.8823, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.3801 => 4.4408, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.28% (4.4433 => 4.5003, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 1.22% (3.1889 => 3.2278, std. dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7352, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9225, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6773, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7082, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.78% (0.4657 => 0.3829, std. dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9284, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3511 => 0.3352, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.54% (6.2785 => 6.1816, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.18% (33.2944 => 32.9003, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5752, std. dev.: 0.0516) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5972, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.29% (0.4533 => 0.4429, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9823, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8429, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2169, std. dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0065) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2370, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 04:22:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 06:22:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629112201.605BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1634?compare_to=1632&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1634, Order: 159417, Start Time: 2012-06-29 10:22:12, End Time: 2012-06-29 11:23:39 To: 1632, Order: 159412, Start Time: 2012-06-29 08:53:48, End Time: 2012-06-29 09:54:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (813 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.67% (10.3673 => 13.0290, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.32% (1.1194 => 1.2685, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (1.7609 => 1.9107, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3660, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.94% (0.3543 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3473 => 0.3699, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.49% (0.3497 => 0.3724, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 6.32% (0.3543 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.26% (0.3561 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.23% (0.3516 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.06% (0.3694 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.80% (0.3828 => 0.4050, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.73% (0.3927 => 0.4152, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 5.71% (0.3886 => 0.4108, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3824, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8649, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 3.69% (0.3282 => 0.3403, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.8172 => 0.8434, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4615 => 0.4745, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 2.75% (0.6030 => 0.6196, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.60% (0.5925 => 0.6079, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.07% (4.9449 => 5.0475, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 1.95% (0.7326 => 0.7469, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5569 => 0.5671, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (5.0018 => 5.0887, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (9.4845 => 9.6317, std. dev.: 0.0094) MultiSource/Applications/spiff/spiff: 1.48% (0.7835 => 0.7951, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.19% (8.1363 => 8.2329, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (4.2646 => 4.3101, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.01% (5.7591 => 5.8171, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7849, std. dev.: 0.0339) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2366, std. dev.: 0.0260) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.96% (5.2763 => 3.1679, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7091, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7061, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5473, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -12.73% (22.1758 => 19.3533, std. dev.: 0.0252) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5450, std. dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.84% (3.8922 => 3.7816, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.93% (0.8101 => 0.7945, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (7.9617 => 7.8639, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.93% (1.2373 => 1.1144, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.52% (19.9488 => 18.6481, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9240, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6934, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -2.02% (10.2830 => 10.0757, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 05:26:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 07:26:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629122626.443162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1635?compare_to=1631&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1635, Order: 159417, Start Time: 2012-06-29 10:12:25, End Time: 2012-06-29 12:28:04 To: 1631, Order: 159410, Start Time: 2012-06-29 07:29:38, End Time: 2012-06-29 09:45:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (22 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 892 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.90% (0.3704 => 0.4404, std. dev.: 0.0249) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.01% (2.0455 => 2.0866, std. dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.07% (0.3446 => 0.3655, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.06% (0.3465 => 0.3675, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.04% (0.3496 => 0.3707, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3442 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.90% (0.3460 => 0.3664, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.82% (0.3469 => 0.3671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.82% (0.3488 => 0.3691, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.79% (0.3643 => 0.3854, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 5.78% (0.3650 => 0.3861, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.48% (0.3724 => 0.3928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.06% (0.5826 => 0.6004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.78% (0.5889 => 0.6053, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (0.5026 => 0.5161, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (2.0673 => 2.1155, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.19% (0.7171 => 0.7328, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (1.6211 => 1.6562, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.5900 => 0.6024, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.07% (0.9909 => 1.0114, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.81% (3.5627 => 3.6271, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 1.79% (0.9697 => 0.9871, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.55% (1.3152 => 1.3356, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.40% (4.2109 => 4.2699, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.91% (11.9555 => 11.6079, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.4253 => 0.4151, std. dev.: 0.0010) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 07:12:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 09:12:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629141221.8CE132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1636?compare_to=1633&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1636, Order: 159422, Start Time: 2012-06-29 13:17:28, End Time: 2012-06-29 14:13:59 To: 1633, Order: 159417, Start Time: 2012-06-29 09:37:39, End Time: 2012-06-29 10:34:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (106 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.61% (1.0962 => 1.1138, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.82% (2.0176 => 2.2762, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 5.76% (0.5818 => 0.6153, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5748 => 0.6070, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7061 => 0.7426, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4328 => 0.4547, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7038 => 0.7384, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.85% (1.3693 => 1.4357, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 4.65% (0.4062 => 0.4251, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.44% (0.5265 => 0.5499, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.7710 => 0.8047, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 4.31% (0.2781 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.13% (3.9660 => 4.1298, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 4.13% (0.2690 => 0.2801, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2628 => 0.2735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.94% (1.9828 => 2.0610, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.92% (0.3899 => 0.4052, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.6959 => 0.7229, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.85% (0.3580 => 0.3718, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2726 => 0.2831, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2761 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.73% (0.3107 => 0.3223, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3453 => 0.3580, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (0.3485 => 0.3610, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3149 => 0.3260, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4016 => 0.4155, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3192 => 0.3301, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.37% (0.3293 => 0.3404, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3534 => 0.3653, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2645, std. dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.10% (0.4390 => 0.4526, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.2193 => 1.2568, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5577 => 0.5741, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.92% (0.3868 => 0.3981, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.3245 => 1.3610, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0597, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (1.4563 => 1.4954, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (3.8646 => 3.9651, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.56% (1.1061 => 1.1344, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.49% (0.7506 => 0.7693, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (4.9865 => 5.1090, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.37% (1.9270 => 1.9726, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (1.3813 => 1.4134, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.3819 => 1.4135, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2292 => 1.2570, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.16% (0.7460 => 0.7621, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (7.2180 => 7.3579, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5332, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7376, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2166, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.65% (14.8535 => 15.0987, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.52% (0.8698 => 0.8830, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (6.5754 => 6.6735, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (4.3801 => 4.4397, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (4.4433 => 4.4999, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.86% (1.8175 => 2.2694, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.43% (0.9996 => 1.0839, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.67% (1.2998 => 1.3995, std. dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7079, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std. dev.: 0.0213) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9349, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3511 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.2785 => 6.1932, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -1.03% (33.2944 => 32.9520, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.51% (1.2308 => 1.1138, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.95% (20.3410 => 18.5212, std. dev.: 0.0933) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6025, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5004, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -1.52% (3.0263 => 2.9803, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8442, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2455, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0102) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2166, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2484, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 07:17:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 09:17:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629141729.155BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1637?compare_to=1634&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1637, Order: 159422, Start Time: 2012-06-29 13:17:47, End Time: 2012-06-29 14:19:07 To: 1634, Order: 159417, Start Time: 2012-06-29 10:22:12, End Time: 2012-06-29 11:23:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (42 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (813 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.03% (2.3004 => 2.2767, std. dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.62% (10.3673 => 13.0236, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.24% (1.1194 => 1.2676, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (1.7609 => 1.9111, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.47% (2.2022 => 2.3668, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3473 => 0.3699, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.37% (0.3516 => 0.3740, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-2: 6.32% (0.3497 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3543 => 0.3765, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 6.24% (0.3543 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.23% (0.3561 => 0.3783, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.01% (0.3694 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.93% (0.3828 => 0.4055, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.89% (0.3886 => 0.4115, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.83% (0.3927 => 0.4156, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.63% (7.0540 => 7.3805, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (10.4361 => 10.8625, std. dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.78% (0.3177 => 0.3297, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 3.69% (0.3282 => 0.3403, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.82% (0.6030 => 0.6200, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (0.7433 => 0.7637, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 2.68% (0.5925 => 0.6084, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.8172 => 0.8339, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 2.02% (0.7326 => 0.7474, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.9449 => 5.0434, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (5.0018 => 5.0916, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (9.4845 => 9.6348, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: 1.31% (0.7835 => 0.7938, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.23% (1.5415 => 1.5605, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.2646 => 4.3162, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.1363 => 8.2340, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 1.03% (5.7591 => 5.8187, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.82% (26.0924 => 26.8274, std. dev.: 0.0204) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5086 => 1.5359, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2395, std. dev.: 0.0272) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6874, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.05% (1.3045 => 1.3182, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1655, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7071, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7010, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5458, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -12.71% (22.1758 => 19.3568, std. dev.: 0.0280) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4656, std. dev.: 0.0534) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.71% (3.8922 => 3.7869, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.91% (0.8101 => 0.7946, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8798, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2373 => 1.1182, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.62% (19.9488 => 18.6289, std. dev.: 0.0546) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9229, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6864, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0835, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 08:31:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 10:31:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629153117.7D6BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1638?compare_to=1635&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1638, Order: 159422, Start Time: 2012-06-29 13:17:25, End Time: 2012-06-29 15:32:54 To: 1635, Order: 159417, Start Time: 2012-06-29 10:12:25, End Time: 2012-06-29 12:28:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (24 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.57% (0.3792 => 0.4496, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3488 => 0.3699, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 5.98% (0.3446 => 0.3652, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.97% (0.3465 => 0.3672, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.95% (0.3496 => 0.3704, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.90% (0.3460 => 0.3664, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.85% (0.3643 => 0.3856, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.82% (0.3469 => 0.3671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.81% (0.3442 => 0.3642, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.56% (0.3650 => 0.3853, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.48% (0.3724 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.00% (0.5826 => 0.6001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 2.67% (0.5889 => 0.6046, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.36% (0.7171 => 0.7340, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (1.6211 => 1.6581, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0673 => 2.1133, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.18% (0.9909 => 1.0125, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.5900 => 0.6026, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (0.5026 => 0.5129, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.88% (3.5627 => 3.6297, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 1.80% (0.9697 => 0.9872, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.54% (4.2109 => 4.2757, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.33% (1.3152 => 1.3327, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.44% (0.2122 => 0.2301, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.86% (11.9555 => 11.6137, std. dev.: 0.0137) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 08:35:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 10:35:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629153557.C01532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1639?compare_to=1636&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1639, Order: 159426, Start Time: 2012-06-29 14:41:04, End Time: 2012-06-29 15:37:36 To: 1636, Order: 159422, Start Time: 2012-06-29 13:17:28, End Time: 2012-06-29 14:13:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.95% (2.0176 => 2.2788, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.5818 => 0.6167, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5748 => 0.6082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7061 => 0.7434, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.7038 => 0.7398, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.04% (0.4328 => 0.4546, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.84% (1.3693 => 1.4356, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.7710 => 0.8065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.60% (0.4062 => 0.4249, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.5265 => 0.5503, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.44% (3.9660 => 4.1421, std. dev.: 0.0143) SingleSource/Regression/C++/ofstream_ctor: 4.31% (0.2781 => 0.2901, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.15% (0.2966 => 0.3089, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.07% (0.2655 => 0.2763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.03% (0.2607 => 0.2712, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.95% (0.2760 => 0.2869, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2765 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (1.9828 => 2.0599, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.2937 => 0.3051, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.87% (0.2690 => 0.2794, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.6959 => 0.7225, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2761 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3107 => 0.3225, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.48% (13.8202 => 14.3016, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.47% (0.3485 => 0.3606, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.4016 => 0.4154, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3192 => 0.3299, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.2193 => 1.2591, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.23% (0.4390 => 0.4532, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3245 => 1.3632, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (3.8646 => 3.9714, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.74% (16.6129 => 17.0686, std. dev.: 0.0177) MultiSource/Applications/spiff/spiff: 2.72% (0.7506 => 0.7710, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4379 => 0.4495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 2.62% (0.4003 => 0.4108, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1139, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.52% (1.9270 => 1.9755, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.35% (1.3813 => 1.4137, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2292 => 1.2570, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5804, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.22% (1.3819 => 1.4126, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (7.2180 => 7.3774, std. dev.: 0.0080) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2227, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (3.6692 => 3.7424, std. dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.84% (14.8535 => 15.1274, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (6.5754 => 6.6906, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.8698 => 0.8844, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.3801 => 4.4468, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.4433 => 4.5107, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.31% (3.1889 => 3.2308, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2725, std. dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std. dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7434, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7093, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9717, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.59% (0.3511 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.28% (6.2785 => 6.1983, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2308 => 1.1092, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.70% (20.3410 => 18.5706, std. dev.: 0.0617) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9817, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8474, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8695, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2433, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2257, std. dev.: 0.0331) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2384, std. dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2625, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 08:46:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 10:46:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629154607.CA6A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1640?compare_to=1637&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1640, Order: 159426, Start Time: 2012-06-29 14:46:21, End Time: 2012-06-29 15:47:46 To: 1637, Order: 159422, Start Time: 2012-06-29 13:17:47, End Time: 2012-06-29 14:19:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (43 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.24% (13.0236 => 13.3151, std. dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.43% (10.3673 => 13.3151, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.43% (1.1194 => 1.2697, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.88% (1.7609 => 1.9172, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.24% (2.2022 => 2.3617, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3473 => 0.3703, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.35% (0.3497 => 0.3719, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.32% (0.3543 => 0.3767, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.26% (0.3516 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.24% (0.3543 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.18% (0.3561 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.09% (0.3694 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.88% (0.3828 => 0.4053, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.81% (0.3927 => 0.4155, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.74% (0.3886 => 0.4109, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3748, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.3177 => 0.3320, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8651, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 3.28% (0.6030 => 0.6228, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 3.19% (0.5925 => 0.6114, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7433 => 0.7646, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.75% (0.4615 => 0.4742, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.47% (0.7326 => 0.7507, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.8172 => 0.8366, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5569 => 0.5694, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.9449 => 5.0463, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (5.0018 => 5.0942, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (9.4845 => 9.6456, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: 1.49% (0.7835 => 0.7952, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (8.1363 => 8.2430, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.29% (4.2646 => 4.3197, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.19% (5.7591 => 5.8274, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8245, std. dev.: 0.0216) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2357, std. dev.: 0.0161) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.56% (5.2763 => 3.1890, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7099, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7072, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.89% (2.9384 => 2.5597, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.66% (22.1758 => 19.3694, std. dev.: 0.0265) SingleSource/UnitTests/Vector/constpool: -4.72% (54.1659 => 51.6083, std. dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.48% (3.8922 => 3.7957, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.93% (0.8101 => 0.7945, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (7.9617 => 7.8727, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.36% (19.9488 => 18.4801, std. dev.: 0.1069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9141, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6861, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 09:59:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 11:59:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629165942.ECEBD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1641?compare_to=1639&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1641, Order: 159428, Start Time: 2012-06-29 16:04:41, End Time: 2012-06-29 17:01:21 To: 1639, Order: 159426, Start Time: 2012-06-29 14:41:04, End Time: 2012-06-29 15:37:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (746 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.03% (2.2725 => 2.3413, std. dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2769, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.5818 => 0.6167, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5748 => 0.6085, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7061 => 0.7433, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.07% (0.7038 => 0.7395, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5265 => 0.5529, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (0.4328 => 0.4544, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7710 => 0.8092, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.86% (1.3693 => 1.4358, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.47% (0.2596 => 0.2712, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.36% (3.9660 => 4.1389, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 4.35% (0.2781 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3022 => 0.3153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.2966 => 0.3091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.13% (0.2782 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.10% (0.2607 => 0.2714, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2655 => 0.2762, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2765 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3580 => 0.3722, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3489 => 0.3626, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.88% (0.2628 => 0.2730, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (1.9828 => 2.0597, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 3.88% (0.2761 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3107 => 0.3225, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.71% (0.6959 => 0.7217, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 3.68% (0.3149 => 0.3265, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.55% (13.8202 => 14.3105, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.50% (0.3485 => 0.3607, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9199 => 0.9515, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.4016 => 0.4152, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3192 => 0.3299, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.2193 => 1.2588, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.17% (0.3534 => 0.3646, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.4563 => 1.4997, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.97% (0.3868 => 0.3983, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.80% (1.3245 => 1.3616, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9727, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1358, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0495, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: 2.61% (0.3914 => 0.4016, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4379 => 0.4493, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 2.57% (0.4003 => 0.4106, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1124, std. dev.: 0.0174) MultiSource/Applications/spiff/spiff: 2.52% (0.7506 => 0.7695, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.49% (1.9270 => 1.9749, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (1.3813 => 1.4145, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.35% (1.2292 => 1.2581, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.22% (7.2180 => 7.3780, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5783, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4124, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (3.6692 => 3.7390, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2205, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.84% (14.8535 => 15.1267, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.79% (0.6135 => 0.6245, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (6.5754 => 6.6893, std. dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.8698 => 0.8839, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (4.3801 => 4.4488, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.4433 => 4.5070, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.37% (3.1889 => 3.2326, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 28.82% (1.8175 => 2.3413, std. dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.20% (1.2998 => 1.3934, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7252, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6469 => 3.7150, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9682, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3511 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (6.2785 => 6.1997, std. dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.54% (1.2308 => 1.1134, std. dev.: 0.0227) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5944, std. dev.: 0.0740) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6142, std. dev.: 0.0115) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4960, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2590, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -1.51% (3.0263 => 2.9806, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8446, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2335, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 10:14:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 12:14:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629171459.6A5D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1642?compare_to=1640&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1642, Order: 159428, Start Time: 2012-06-29 16:15:17, End Time: 2012-06-29 17:16:37 To: 1640, Order: 159426, Start Time: 2012-06-29 14:46:21, End Time: 2012-06-29 15:47:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (811 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.27% (10.3673 => 13.2983, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.66% (1.1194 => 1.2723, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (1.7609 => 1.9145, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.19% (2.2022 => 2.3605, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.42% (0.3473 => 0.3696, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.29% (0.3497 => 0.3717, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3543 => 0.3765, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 6.24% (0.3543 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.23% (0.3516 => 0.3735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.18% (0.3561 => 0.3781, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.01% (0.3694 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.88% (0.3828 => 0.4053, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.74% (0.3886 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.73% (0.3927 => 0.4152, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3802, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.06% (0.3177 => 0.3306, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8583, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 3.96% (0.3282 => 0.3412, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.6030 => 0.6222, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.16% (0.5925 => 0.6112, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.86% (0.4615 => 0.4747, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.81% (0.7433 => 0.7642, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.8172 => 0.8383, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 2.36% (0.7326 => 0.7499, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.03% (0.5569 => 0.5682, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.86% (4.9449 => 5.0371, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (5.0018 => 5.0909, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (9.4845 => 9.6522, std. dev.: 0.0118) MultiSource/Applications/spiff/spiff: 1.48% (0.7835 => 0.7951, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.1363 => 8.2423, std. dev.: 0.0178) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.22% (4.2646 => 4.3165, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.18% (1.5415 => 1.5597, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.16% (5.7591 => 5.8257, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.06% (1.5603 => 1.5769, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8330, std. dev.: 0.0308) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5387, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2288, std. dev.: 0.0360) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.67% (5.2763 => 3.1831, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7101, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7104, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.95% (2.9384 => 2.5579, std. dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -12.62% (22.1758 => 19.3765, std. dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -4.77% (54.1659 => 51.5846, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (3.8922 => 3.7972, std. dev.: 0.0223) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8101 => 0.7941, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.21% (7.9617 => 7.8655, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2373 => 1.1054, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9488 => 18.5614, std. dev.: 0.0511) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9247, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6936, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 11:14:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 13:14:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629181401.2780A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1643?compare_to=1638&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1643, Order: 159428, Start Time: 2012-06-29 15:59:54, End Time: 2012-06-29 18:15:39 To: 1638, Order: 159422, Start Time: 2012-06-29 13:17:25, End Time: 2012-06-29 15:32:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (26 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (866 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.92% (2.0359 => 2.1158, std. dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.56% (0.3792 => 0.4382, std. dev.: 0.0132) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.3496 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.41% (0.3465 => 0.3687, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.38% (0.3446 => 0.3666, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3488 => 0.3710, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.33% (0.3460 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.30% (0.3442 => 0.3659, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.28% (0.3469 => 0.3687, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.26% (0.3643 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.95% (0.3650 => 0.3867, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 5.83% (0.3724 => 0.3941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.28% (0.5826 => 0.6017, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (0.5026 => 0.5174, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.89% (0.5889 => 0.6059, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.73% (0.5900 => 0.6061, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (2.0673 => 2.1216, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (1.6211 => 1.6615, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 2.44% (0.9909 => 1.0151, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (0.4361 => 0.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (3.5627 => 3.6399, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.12% (0.9697 => 0.9903, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 1.98% (0.7171 => 0.7313, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.86% (4.2109 => 4.2893, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (1.3152 => 1.3382, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.02% (1.8794 => 1.8985, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.62% (2.0820 => 2.1158, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.93% (2.4764 => 2.3790, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: -2.76% (11.9555 => 11.6252, std. dev.: 0.0045) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 11:23:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 13:23:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629182328.296232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1644?compare_to=1641&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1644, Order: 159436, Start Time: 2012-06-29 17:28:27, End Time: 2012-06-29 18:25:06 To: 1641, Order: 159428, Start Time: 2012-06-29 16:04:41, End Time: 2012-06-29 17:01:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.56% (1.3934 => 1.4151, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.99% (2.3413 => 2.2714, std. dev.: 0.0118) SingleSource/Benchmarks/McGill/chomp: -1.29% (1.1134 => 1.0990, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2779, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5748 => 0.6109, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.5818 => 0.6170, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.40% (0.7061 => 0.7442, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (0.7038 => 0.7411, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 4.99% (1.3693 => 1.4376, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.73% (0.5265 => 0.5514, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.54% (0.7710 => 0.8060, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.41% (3.9660 => 4.1410, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3022 => 0.3155, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.2781 => 0.2903, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.39% (0.2782 => 0.2904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.32% (0.2966 => 0.3094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2726 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.11% (0.3580 => 0.3727, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.9828 => 2.0624, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2765 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3489 => 0.3625, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.78% (0.2696 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.65% (0.9199 => 0.9535, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (0.3485 => 0.3612, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3453 => 0.3578, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.58% (13.8202 => 14.3144, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5637 => 0.5835, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.35% (0.2988 => 0.3088, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.08% (0.3868 => 0.3987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 2.96% (0.3578 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.88% (1.1364 => 1.1691, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.4563 => 1.4981, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 2.85% (0.4003 => 0.4117, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (3.8646 => 3.9733, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (0.4379 => 0.4501, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 2.78% (0.3914 => 0.4023, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.78% (0.7506 => 0.7715, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3646 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.77% (0.3650 => 0.3751, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.73% (16.6129 => 17.0662, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.68% (1.1061 => 1.1357, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 2.61% (0.3940 => 0.4043, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1136, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.52% (1.9270 => 1.9756, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.40% (1.2292 => 1.2587, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4141, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (7.2180 => 7.3816, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5809, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (3.6692 => 3.7417, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.88% (14.8535 => 15.1326, std. dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.1333 => 1.1544, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.72% (6.5754 => 6.6886, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.8698 => 0.8840, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.3801 => 4.4512, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (4.4433 => 4.5100, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2320, std. dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.5298 => 14.6799, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2714, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel-2: 8.87% (1.2998 => 1.4151, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7326, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7062, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8563, std. dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.97% (22.5627 => 20.9903, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.39% (0.3511 => 0.3357, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.48% (0.9108 => 0.8973, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2076, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.2308 => 1.0990, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5894, std. dev.: 0.0396) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5936, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9792, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8436, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2363, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2543, std. dev.: 0.0176) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 11:43:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 13:43:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629184334.136A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1645?compare_to=1642&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1645, Order: 159436, Start Time: 2012-06-29 17:43:52, End Time: 2012-06-29 18:45:12 To: 1642, Order: 159428, Start Time: 2012-06-29 16:15:17, End Time: 2012-06-29 17:16:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (41 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (815 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.37% (7.9381 => 8.0468, std. dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.04% (10.3673 => 13.2747, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.39% (1.1194 => 1.2693, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.71% (1.7609 => 1.9143, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.21% (2.2022 => 2.3610, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 5.61% (0.3473 => 0.3668, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.49% (0.3516 => 0.3709, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.45% (0.3543 => 0.3736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 5.43% (0.3497 => 0.3687, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.36% (0.3561 => 0.3752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.36% (0.3543 => 0.3733, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 5.20% (0.3694 => 0.3886, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 5.09% (0.3828 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.04% (0.3927 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.99% (0.3886 => 0.4080, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3756, std. dev.: 0.0237) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (10.4361 => 10.8502, std. dev.: 0.0188) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7433 => 0.7631, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 2.34% (0.6030 => 0.6171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.31% (0.5925 => 0.6062, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.9449 => 5.0480, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (5.0018 => 5.0863, std. dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (9.4845 => 9.6424, std. dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: 1.56% (0.7326 => 0.7440, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (8.1363 => 8.2345, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.16% (4.2646 => 4.3139, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.11% (1.5415 => 1.5586, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.07% (5.7591 => 5.8209, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7751, std. dev.: 0.0215) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5387, std. dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2446, std. dev.: 0.0413) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6908, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.76% (5.2763 => 3.1786, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7093, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7038, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5470, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: -12.66% (22.1758 => 19.3674, std. dev.: 0.0416) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5031, std. dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.52% (3.8922 => 3.7942, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.02% (0.8101 => 0.7937, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1156, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.80% (19.9488 => 18.5920, std. dev.: 0.0666) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.74% (8.1563 => 7.9331, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6849, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 12:47:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 14:47:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629194715.B209B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1646?compare_to=1644&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1646, Order: 159442, Start Time: 2012-06-29 18:52:15, End Time: 2012-06-29 19:48:53 To: 1644, Order: 159436, Start Time: 2012-06-29 17:28:27, End Time: 2012-06-29 18:25:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (109 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (744 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.28% (7.9544 => 8.0561, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.0990 => 1.1113, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.97% (2.0176 => 2.2793, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5748 => 0.6082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.79% (0.5818 => 0.6155, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7061 => 0.7429, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.7038 => 0.7398, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4328 => 0.4548, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.94% (1.3693 => 1.4369, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.69% (0.5265 => 0.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (3.9660 => 4.1385, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.35% (0.7710 => 0.8045, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.32% (0.2966 => 0.3094, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2782 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2655 => 0.2765, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.02% (0.3580 => 0.3724, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.01% (0.2690 => 0.2798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.3489 => 0.3629, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (1.9828 => 2.0620, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 3.98% (0.2937 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2765 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2726 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.88% (0.2761 => 0.2868, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.87% (0.3899 => 0.4050, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.86% (0.3107 => 0.3227, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.84% (0.3149 => 0.3270, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4016 => 0.4168, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.6959 => 0.7220, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.74% (0.3453 => 0.3582, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3756 => 0.3891, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.57% (13.8202 => 14.3133, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3485 => 0.3609, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3534 => 0.3658, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 3.45% (0.3192 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.34% (0.3293 => 0.3403, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4390 => 0.4534, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.2193 => 1.2575, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3868 => 0.3988, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (3.8646 => 3.9674, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 2.62% (16.6129 => 17.0477, std. dev.: 0.0253) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.56% (0.7506 => 0.7698, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 2.55% (0.4003 => 0.4105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.55% (1.3819 => 1.4171, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.54% (4.9865 => 5.1132, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4152, std. dev.: 0.0130) MultiSource/Applications/treecc/treecc: 2.42% (1.9270 => 1.9737, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2292 => 1.2578, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.2842 => 13.5653, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (7.2180 => 7.3674, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (3.6692 => 3.7416, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2205, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.83% (14.8535 => 15.1251, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.8698 => 0.8848, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.69% (6.5754 => 6.6866, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.50% (4.3801 => 4.4458, std. dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.31% (3.1889 => 3.2307, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1333 => 1.1470, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7329, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9232, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.38% (1.7688 => 1.8286, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7078, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1933, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9652, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.56% (0.3511 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (6.2785 => 6.1999, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2308 => 1.1113, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.42% (20.3410 => 18.4240, std. dev.: 0.1307) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5805, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4462, std. dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.30% (0.4867 => 0.4755, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.62% (3.0263 => 2.9772, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0169) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8451, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2188, std. dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2410, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.18% (0.9692 => 0.9578, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.15% (3.8887 => 3.8439, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 13:12:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 15:12:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629201226.DB6F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1647?compare_to=1645&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1647, Order: 159448, Start Time: 2012-06-29 19:12:34, End Time: 2012-06-29 20:14:05 To: 1645, Order: 159436, Start Time: 2012-06-29 17:43:52, End Time: 2012-06-29 18:45:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (38 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.38% (10.3673 => 13.2056, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.54% (1.1194 => 1.2598, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.96% (1.7609 => 1.9010, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3473 => 0.3713, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.69% (2.2022 => 2.3496, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3497 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.63% (0.3543 => 0.3778, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3543 => 0.3778, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.54% (0.3561 => 0.3794, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.54% (0.3516 => 0.3746, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.31% (0.3694 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3828 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.00% (0.3886 => 0.4119, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.88% (0.3927 => 0.4158, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (7.0540 => 7.3374, std. dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (10.4361 => 10.8501, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.71% (0.3177 => 0.3295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.00% (0.5925 => 0.6103, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.95% (0.6030 => 0.6208, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.52% (0.7433 => 0.7620, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.37% (0.5569 => 0.5701, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.8172 => 0.8351, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 2.18% (0.7326 => 0.7486, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.9449 => 5.0283, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (5.0018 => 5.0834, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (9.4845 => 9.6169, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.1363 => 8.2367, std. dev.: 0.0099) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (4.2646 => 4.3146, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7651, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.8001, std. dev.: 0.0249) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2497, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1612, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6990, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6935, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5406, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.78% (22.1758 => 19.3420, std. dev.: 0.0175) SingleSource/UnitTests/Vector/constpool: -4.82% (54.1659 => 51.5551, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.88% (3.8922 => 3.7800, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.8101 => 0.7955, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (7.9617 => 7.8609, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5546, std. dev.: 0.0807) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.74% (8.1563 => 7.9331, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.50% (32.5116 => 31.6980, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 13:56:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 15:56:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629205635.E210E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1648?compare_to=1643&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1648, Order: 159442, Start Time: 2012-06-29 18:42:46, End Time: 2012-06-29 20:58:14 To: 1643, Order: 159428, Start Time: 2012-06-29 15:59:54, End Time: 2012-06-29 18:15:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (22 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (869 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.62% (0.3792 => 0.4612, std. dev.: 0.0276) SingleSource/UnitTests/ObjC/exceptions-3: 6.01% (0.3460 => 0.3668, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.01% (0.3446 => 0.3653, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.00% (0.3465 => 0.3673, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.98% (0.3496 => 0.3705, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3442 => 0.3645, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.88% (0.3488 => 0.3693, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 5.82% (0.3469 => 0.3671, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 5.79% (0.3643 => 0.3854, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.64% (0.3650 => 0.3856, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.48% (0.3724 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.04% (0.5826 => 0.6003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.84% (0.5889 => 0.6056, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (0.5026 => 0.5168, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.51% (0.7171 => 0.7351, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (1.6211 => 1.6603, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (2.0673 => 2.1139, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.16% (0.9909 => 1.0123, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (0.5900 => 0.6015, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (3.5627 => 3.6294, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 1.67% (0.9697 => 0.9859, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.51% (4.2109 => 4.2743, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.05% (2.4764 => 2.3762, std. dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: -2.65% (11.9555 => 11.6383, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.4253 => 0.4143, std. dev.: 0.0013) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 14:10:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 16:10:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629211058.EA8582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1649?compare_to=1646&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1649, Order: 159454, Start Time: 2012-06-29 20:15:59, End Time: 2012-06-29 21:12:36 To: 1646, Order: 159442, Start Time: 2012-06-29 18:52:15, End Time: 2012-06-29 19:48:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (727 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.09% (2.0176 => 2.2817, std. dev.: 0.0144) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.5818 => 0.6230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.98% (0.5748 => 0.6149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7061 => 0.7516, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.32% (1.3693 => 1.4421, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.17% (0.7038 => 0.7402, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3485 => 0.3651, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.7710 => 0.8076, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0763, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.67% (0.5265 => 0.5511, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (3.9660 => 4.1507, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3580 => 0.3736, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3489 => 0.3641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.19% (0.3578 => 0.3728, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.05% (0.3650 => 0.3798, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.04% (0.3914 => 0.4072, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.6959 => 0.7233, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 3.92% (0.3601 => 0.3742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 3.89% (0.3623 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.87% (0.3646 => 0.3787, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.85% (0.3663 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.83% (0.3940 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.83% (0.3789 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.82% (0.4003 => 0.4156, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.70% (13.8202 => 14.3310, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.2193 => 1.2603, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5577 => 0.5753, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5014, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3245 => 1.3650, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5637 => 0.5808, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.3819 => 1.4228, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.3813 => 1.4207, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.2292 => 1.2642, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.83% (1.1061 => 1.1374, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0825, std. dev.: 0.0172) MultiSource/Applications/spiff/spiff: 2.82% (0.7506 => 0.7718, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8646 => 3.9735, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 2.66% (1.9270 => 1.9783, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.56% (4.9865 => 5.1144, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.48% (7.2180 => 7.3969, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6033, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (3.6692 => 3.7489, std. dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.8698 => 0.8884, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2221, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.96% (14.8535 => 15.1439, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7013, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4623, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6135 => 0.6249, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (4.4433 => 4.5207, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.51% (3.1889 => 3.2372, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.1333 => 1.1497, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.31% (14.5298 => 14.7198, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.95% (0.4846 => 0.6976, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.91% (1.8175 => 2.2703, std. dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.80% (1.2998 => 1.3882, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7359, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.55% (1.5089 => 1.5323, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.48% (3.6469 => 3.7010, std. dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.20% (10.7476 => 10.8770, std. dev.: 0.0385) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.77% (0.4657 => 0.3969, std. dev.: 0.0222) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9671, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3511 => 0.3365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2136, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5000, std. dev.: 0.0751) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5877, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0095) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9793, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8481, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2278, std. dev.: 0.0376) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2553, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2399, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 14:41:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 16:41:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629214113.B52742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1650?compare_to=1647&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1650, Order: 159457, Start Time: 2012-06-29 20:41:31, End Time: 2012-06-29 21:42:51 To: 1647, Order: 159448, Start Time: 2012-06-29 19:12:34, End Time: 2012-06-29 20:14:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (36 on baseline) Performance Improvements: 1 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.46% (13.2056 => 12.8805, std. dev.: 0.0128) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.24% (10.3673 => 12.8805, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.52% (1.1194 => 1.2595, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.82% (1.7609 => 1.8986, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3543 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3473 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.10% (0.3543 => 0.3759, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.08% (2.2022 => 2.3361, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.71% (0.3694 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.59% (0.3828 => 0.4042, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.58% (0.3927 => 0.4146, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.48% (0.3886 => 0.4099, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.65% (0.4879 => 0.5057, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.53% (0.3177 => 0.3289, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.4361 => 10.7998, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.46% (7.0540 => 7.2980, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 2.79% (0.6030 => 0.6198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.77% (0.5925 => 0.6089, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (0.7433 => 0.7635, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.07% (0.8172 => 0.8341, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 2.02% (0.7326 => 0.7474, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (5.0018 => 5.0807, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.54% (4.9449 => 5.0211, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.33% (0.7835 => 0.7939, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (9.4845 => 9.6049, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.1363 => 8.2214, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.01% (4.2646 => 4.3077, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.77% (26.0924 => 26.8154, std. dev.: 0.0509) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5343, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2427, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1551, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6814, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6747, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5361, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -13.01% (22.1758 => 19.2916, std. dev.: 0.0398) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3232, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.96% (3.8922 => 3.7771, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8101 => 0.7941, std. dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.60% (7.9617 => 7.8345, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: -1.03% (21.9371 => 21.7119, std. dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2373 => 1.1065, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5691, std. dev.: 0.0661) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9108, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6962, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 15:35:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 17:35:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629223505.053382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1651?compare_to=1649&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1651, Order: 159462, Start Time: 2012-06-29 21:40:00, End Time: 2012-06-29 22:36:41 To: 1649, Order: 159454, Start Time: 2012-06-29 20:15:59, End Time: 2012-06-29 21:12:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.53% (1.3882 => 1.4094, std. dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.53% (2.0176 => 2.2705, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.5818 => 0.6250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.20% (0.5748 => 0.6162, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7061 => 0.7539, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.07% (1.3693 => 1.4387, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.91% (0.2607 => 0.2735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.90% (0.4062 => 0.4261, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7038 => 0.7381, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2655 => 0.2784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.64% (1.9828 => 2.0748, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2726 => 0.2849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.42% (0.3578 => 0.3736, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.7710 => 0.8046, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3489 => 0.3638, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.22% (0.3601 => 0.3753, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.18% (0.3899 => 0.4062, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5265 => 0.5485, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.16% (0.3914 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.16% (0.3650 => 0.3802, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 4.15% (0.3663 => 0.3815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.14% (0.3789 => 0.3946, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.14% (3.9660 => 4.1301, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 4.11% (0.3623 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.10% (0.4003 => 0.4167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.98% (0.3940 => 0.4097, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3756 => 0.3898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.33% (13.8202 => 14.2800, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9199 => 0.9484, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.77% (16.6129 => 17.0726, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.67% (0.5577 => 0.5726, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.67% (1.2292 => 1.2620, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (4.9865 => 5.1187, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.4563 => 1.4940, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.54% (1.3245 => 1.3582, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9620, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.0594 => 1.0856, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.44% (0.4379 => 0.4486, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 2.38% (0.7506 => 0.7685, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9694, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.16% (1.3813 => 1.4111, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3681, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (1.3819 => 1.4103, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (13.2842 => 13.5311, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 1.83% (0.8310 => 0.8462, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (3.6692 => 3.7315, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.54% (2.1791 => 2.2127, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0692, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.40% (6.5754 => 6.6677, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.3801 => 4.4411, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.29% (4.4433 => 4.5005, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.02% (3.1889 => 3.2214, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.93% (1.8175 => 2.2888, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 8.43% (1.2998 => 1.4094, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7369, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6469 => 3.7159, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9590, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.12% (10.7476 => 10.8678, std. dev.: 0.0298) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9235, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.64% (0.3511 => 0.3348, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.64% (0.8818 => 0.8497, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.06% (0.9108 => 0.8920, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.43% (6.2785 => 6.1890, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5185, std. dev.: 0.0943) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5942, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.29% (0.4533 => 0.4429, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9792, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8477, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2148, std. dev.: 0.0378) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2379, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2333, std. dev.: 0.0212) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 16:11:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 18:11:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120629231128.4C1F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1652?compare_to=1650&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1652, Order: 159465, Start Time: 2012-06-29 22:11:51, End Time: 2012-06-29 23:13:06 To: 1650, Order: 159457, Start Time: 2012-06-29 20:41:31, End Time: 2012-06-29 21:42:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (38 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (12.8805 => 13.1365, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.71% (10.3673 => 13.1365, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.81% (1.1194 => 1.2628, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.55% (1.7609 => 1.8939, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.50% (2.2022 => 2.3453, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.19% (0.3473 => 0.3688, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.07% (0.3561 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3497 => 0.3708, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3543 => 0.3756, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.98% (0.3543 => 0.3755, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 5.97% (0.3516 => 0.3726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.90% (0.3694 => 0.3912, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 5.54% (0.3828 => 0.4040, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.51% (0.3886 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.3927 => 0.4143, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3235, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.73% (0.4879 => 0.5061, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (10.4361 => 10.8182, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.53% (0.3177 => 0.3289, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 3.10% (0.6030 => 0.6217, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.00% (0.5925 => 0.6103, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.95% (0.7326 => 0.7542, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (0.7433 => 0.7635, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (5.0018 => 5.0844, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.9449 => 5.0263, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: 1.46% (0.7835 => 0.7949, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (9.4845 => 9.6161, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (8.1363 => 8.2368, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.2646 => 4.3153, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.13% (2.0665 => 2.0899, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.03% (1.5603 => 1.5764, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8085, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4459, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2304, std. dev.: 0.0399) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1560, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.46% (5.3855 => 3.6911, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6849, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.79% (22.1758 => 19.3394, std. dev.: 0.0178) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3365, std. dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.99% (3.8922 => 3.7758, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.83% (0.8101 => 0.7953, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (7.9617 => 7.8623, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.15% (19.9488 => 18.5218, std. dev.: 0.0260) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9210, std. dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6906, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 16:39:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 18:39:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120629233920.2FB492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1653?compare_to=1648&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1653, Order: 159459, Start Time: 2012-06-29 21:25:20, End Time: 2012-06-29 23:40:58 To: 1648, Order: 159442, Start Time: 2012-06-29 18:42:46, End Time: 2012-06-29 20:58:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (32 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 892 (860 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (2.0995 => 2.1280, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (2.7360 => 2.7677, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.58% (0.3792 => 0.4686, std. dev.: 0.0257) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3488 => 0.3749, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.44% (0.3442 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.40% (0.3446 => 0.3701, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.39% (0.3465 => 0.3721, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.32% (0.3496 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3460 => 0.3713, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.27% (0.3643 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3469 => 0.3719, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.3724 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.09% (0.5826 => 0.6064, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.89% (0.5889 => 0.6118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.21% (0.7171 => 0.7401, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (1.6211 => 1.6657, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (0.5026 => 0.5158, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (0.4361 => 0.4475, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.47% (3.5627 => 3.6507, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (0.4994 => 0.5115, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.34% (0.5900 => 0.6038, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (1.3152 => 1.3438, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0673 => 2.1086, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 1.99% (0.9909 => 1.0106, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.95% (4.2109 => 4.2929, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (4.4195 => 4.4859, std. dev.: 0.0114) MultiSource/Applications/d/make_dparser: 1.47% (1.0781 => 1.0939, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (2.7292 => 2.7677, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (1.9694 => 1.9956, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.28% (1.9966 => 2.0222, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (2.1013 => 2.1280, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.13% (0.9697 => 0.9807, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (2.1653 => 2.1871, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.68% (2.4764 => 2.3604, std. dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: -2.62% (11.9555 => 11.6421, std. dev.: 0.0100) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 16:58:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 18:58:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120629235847.175542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1654?compare_to=1651&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1654, Order: 159471, Start Time: 2012-06-29 23:03:48, End Time: 2012-06-30 00:00:25 To: 1651, Order: 159462, Start Time: 2012-06-29 21:40:00, End Time: 2012-06-29 22:36:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2790, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.5818 => 0.6176, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.07% (0.5748 => 0.6097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7061 => 0.7448, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.7038 => 0.7403, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 4.98% (1.3693 => 1.4375, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (0.4328 => 0.4537, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.73% (0.3022 => 0.3165, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4062 => 0.4250, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1417, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.7710 => 0.8051, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2782 => 0.2899, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.17% (0.2781 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.07% (0.2655 => 0.2763, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.07% (0.2607 => 0.2713, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.05% (0.2690 => 0.2799, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.03% (0.2628 => 0.2734, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2760 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.95% (0.2937 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.87% (0.3485 => 0.3620, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.83% (1.9828 => 2.0588, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.75% (0.2696 => 0.2797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.69% (0.6959 => 0.7216, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.4016 => 0.4164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2726 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3580 => 0.3711, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.3489 => 0.3615, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.60% (0.3107 => 0.3219, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3899 => 0.4039, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.55% (13.8202 => 14.3113, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3149 => 0.3257, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3192 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.38% (0.2988 => 0.3089, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (0.3293 => 0.3400, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.22% (1.2193 => 1.2586, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.4563 => 1.5024, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3756 => 0.3873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3534 => 0.3643, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.05% (1.3813 => 1.4234, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 3.01% (0.3914 => 0.4032, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.00% (0.4003 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 2.99% (0.3578 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5577 => 0.5742, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 2.88% (0.3646 => 0.3751, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 2.88% (0.3789 => 0.3898, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 2.87% (0.3940 => 0.4053, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (3.8646 => 3.9732, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-2: 2.80% (0.3601 => 0.3702, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.77% (0.3650 => 0.3751, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (4.9865 => 5.1230, std. dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: 2.71% (16.6129 => 17.0638, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (1.3819 => 1.4186, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.64% (1.1061 => 1.1353, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4379 => 0.4493, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.56% (1.9270 => 1.9764, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.2842 => 13.5958, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (7.2180 => 7.3827, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2292 => 1.2554, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2247, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (3.6692 => 3.7424, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.87% (14.8535 => 15.1317, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (6.5754 => 6.6979, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8698 => 0.8849, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.3801 => 4.4543, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.68% (0.6135 => 0.6238, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.4433 => 4.5140, std. dev.: 0.0068) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2318, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.14% (14.5298 => 14.6948, std. dev.: 0.0176) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 26.82% (1.8175 => 2.3050, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 8.21% (1.2998 => 1.4065, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.14% (0.9996 => 1.0810, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7393, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0179) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5089 => 1.5350, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7045, std. dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.47% (0.4657 => 0.3983, std. dev.: 0.0129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9787, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2054, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5687, std. dev.: 0.0812) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3210, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5991, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2593, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8583, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9823, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8430, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2451, std. dev.: 0.0056) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2224, std. dev.: 0.0181) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2362, std. dev.: 0.0363) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 17:40:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 19:40:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120630004011.B67032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1655?compare_to=1652&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1655, Order: 159472, Start Time: 2012-06-29 23:40:27, End Time: 2012-06-30 00:41:48 To: 1652, Order: 159465, Start Time: 2012-06-29 22:11:51, End Time: 2012-06-29 23:13:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.90% (10.3673 => 13.0522, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.70% (1.1194 => 1.2616, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.83% (1.7609 => 1.8987, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.54% (2.2022 => 2.3463, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.82% (0.3473 => 0.3675, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3543 => 0.3745, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 5.63% (0.3497 => 0.3694, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 5.59% (0.3543 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.57% (0.3516 => 0.3712, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.53% (0.3561 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.33% (0.3694 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.19% (0.3927 => 0.4131, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 5.17% (0.3828 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.15% (0.3886 => 0.4086, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (7.0540 => 7.3345, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.77% (0.4879 => 0.5063, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.68% (0.3177 => 0.3294, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (10.4361 => 10.8171, std. dev.: 0.0170) MultiSource/Applications/lambda-0_1_3/lambda: 3.24% (0.7433 => 0.7674, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 3.20% (0.3282 => 0.3387, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.6030 => 0.6218, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.07% (0.5925 => 0.6107, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7326 => 0.7509, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.8172 => 0.8351, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.15% (0.5569 => 0.5689, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (5.0018 => 5.0956, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.85% (4.9449 => 5.0363, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.76% (0.5860 => 0.5963, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (9.4845 => 9.6463, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.35% (8.1363 => 8.2461, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (4.2646 => 4.3221, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.5415 => 1.5619, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.23% (2.0273 => 2.0523, std. dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8256, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1861 => 1.1992, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.00% (3.3354 => 3.3688, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0055) MultiSource/Applications/lua/lua: 2.59% (26.0924 => 26.7671, std. dev.: 0.0301) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2487, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6912, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1561, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.35% (5.3855 => 3.6972, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6957, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.48% (2.9384 => 2.5424, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: -12.67% (22.1758 => 19.3670, std. dev.: 0.0293) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3369, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.62% (3.8922 => 3.7901, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8101 => 0.7974, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0263) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.72% (19.9488 => 18.6086, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9176, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6836, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 18:22:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 20:22:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120630012229.8CD822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1656?compare_to=1654&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1656, Order: 159475, Start Time: 2012-06-30 00:27:30, End Time: 2012-06-30 01:24:07 To: 1654, Order: 159471, Start Time: 2012-06-29 23:03:48, End Time: 2012-06-30 00:00:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2786, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.77% (0.5818 => 0.6212, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5748 => 0.6125, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.96% (0.7061 => 0.7482, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.11% (0.4328 => 0.4549, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.96% (1.3693 => 1.4372, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4062 => 0.4256, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.59% (0.2765 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.5265 => 0.5503, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.2781 => 0.2906, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.38% (0.7710 => 0.8048, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (3.9660 => 4.1387, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.16% (0.4016 => 0.4183, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (1.9828 => 2.0620, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3107 => 0.3231, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.94% (0.2966 => 0.3083, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2726 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.82% (0.3899 => 0.4048, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.68% (0.3149 => 0.3265, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.55% (13.8202 => 14.3113, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3534 => 0.3655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3192 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.41% (0.2988 => 0.3090, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9199 => 0.9512, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.21% (1.2193 => 1.2585, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.19% (0.3578 => 0.3692, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3868 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.04% (0.3914 => 0.4033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 3.00% (0.4003 => 0.4123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 2.99% (0.3646 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.98% (0.3789 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 2.94% (0.3601 => 0.3707, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.4563 => 1.4988, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.88% (0.3650 => 0.3755, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8646 => 3.9756, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.87% (1.3245 => 1.3625, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 2.87% (0.3940 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.87% (0.3663 => 0.3768, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 2.84% (0.3623 => 0.3726, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0830, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (1.3819 => 1.4209, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.79% (1.3813 => 1.4199, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (0.4379 => 0.4498, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (4.9865 => 5.1191, std. dev.: 0.0212) MultiSource/Applications/spiff/spiff: 2.58% (0.7506 => 0.7700, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 2.53% (1.9270 => 1.9758, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.22% (1.2292 => 1.2565, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5741, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (7.2180 => 7.3731, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.99% (2.1791 => 2.2225, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (3.6692 => 3.7420, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.81% (14.8535 => 15.1229, std. dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 1.71% (6.5754 => 6.6876, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.3801 => 4.4506, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.58% (0.8698 => 0.8835, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5111, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.29% (3.1889 => 3.2301, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.5298 => 14.6794, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std. dev.: 0.0535) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 6.87% (1.2998 => 1.3891, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7403, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.88% (1.4298 => 1.4567, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7080, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std. dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9737, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.10% (0.3511 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2081, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.51% (1.2308 => 1.1137, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.76% (20.3410 => 18.5594, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.31% (8.8259 => 8.6220, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2535, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8561, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9828, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8432, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2504, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2218, std. dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2439, std. dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 19:08:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 21:08:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120630020849.C212C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1657?compare_to=1655&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1657, Order: 159476, Start Time: 2012-06-30 01:09:08, End Time: 2012-06-30 02:10:27 To: 1655, Order: 159472, Start Time: 2012-06-29 23:40:27, End Time: 2012-06-30 00:41:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (810 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.83% (10.3673 => 13.0452, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.88% (1.1194 => 1.2636, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.53% (2.2022 => 2.3461, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.82% (0.3473 => 0.3675, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.66% (0.3497 => 0.3695, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3543 => 0.3742, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 5.62% (0.3561 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3516 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.56% (0.3543 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.33% (0.3694 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.22% (0.3927 => 0.4132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.17% (0.3828 => 0.4026, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.17% (0.3886 => 0.4087, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.2065 => 0.2166, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (7.0540 => 7.3394, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.77% (0.4879 => 0.5063, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (10.4361 => 10.8210, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.56% (0.3177 => 0.3290, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 3.21% (0.5925 => 0.6115, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.20% (0.3282 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.11% (0.8172 => 0.8426, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 3.10% (0.6030 => 0.6217, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.10% (0.4615 => 0.4758, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 3.03% (0.7326 => 0.7548, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7433 => 0.7658, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.9449 => 5.0481, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.08% (0.5569 => 0.5685, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (5.0018 => 5.0975, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (9.4845 => 9.6387, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 1.52% (0.7835 => 0.7954, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.1363 => 8.2437, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3177, std. dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8272, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 1.17% (2.0273 => 2.0510, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.07% (1.1642 => 1.1767, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.02% (1.5415 => 1.5573, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1861 => 1.1981, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 2.75% (26.0924 => 26.8106, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.99% (1.5086 => 1.5386, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2254, std. dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1576, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6993, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.89% (5.3526 => 3.6993, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5415, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.64% (22.1758 => 19.3722, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3462, std. dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.77% (3.8922 => 3.7844, std. dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.62% (0.8101 => 0.7970, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2373 => 1.1060, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5509, std. dev.: 0.0605) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9084, std. dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6771, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0868, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 19:22:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 21:22:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120630022203.48A742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1658?compare_to=1653&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1658, Order: 159474, Start Time: 2012-06-30 00:08:07, End Time: 2012-06-30 02:23:41 To: 1653, Order: 159459, Start Time: 2012-06-29 21:25:20, End Time: 2012-06-29 23:40:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (861 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.2288 => 0.2405, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.54% (0.3446 => 0.3706, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.33% (0.3465 => 0.3719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3488 => 0.3741, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 7.24% (0.3469 => 0.3720, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3460 => 0.3710, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3496 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3442 => 0.3688, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3643 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.79% (0.3650 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.71% (0.3724 => 0.3974, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 4.34% (0.5826 => 0.6079, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.21% (0.5889 => 0.6137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7171 => 0.7431, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.73% (1.6211 => 1.6654, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (0.5026 => 0.5161, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.52% (0.4994 => 0.5120, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (0.4361 => 0.4470, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (3.5627 => 3.6491, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.11% (1.3152 => 1.3430, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0673 => 2.1087, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.00% (0.5000 => 0.5100, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.96% (0.9909 => 1.0103, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.89% (4.2109 => 4.2906, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (1.9694 => 1.9961, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (1.9966 => 2.0233, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.30% (0.9697 => 0.9823, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.18% (1.0781 => 1.0908, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.13% (1.8794 => 1.9006, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.10% (2.7292 => 2.7592, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (4.4195 => 4.4674, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.34% (2.4764 => 2.3690, std. dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: -2.49% (11.9555 => 11.6584, std. dev.: 0.0038) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 19:46:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 21:46:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120630024612.46D442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1659?compare_to=1656&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1659, Order: 159477, Start Time: 2012-06-30 01:51:14, End Time: 2012-06-30 02:47:50 To: 1656, Order: 159475, Start Time: 2012-06-30 00:27:30, End Time: 2012-06-30 01:24:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.5818 => 0.6192, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.25% (0.5748 => 0.6107, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7061 => 0.7467, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.11% (1.3693 => 1.4393, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.1986 => 0.2087, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4328 => 0.4548, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.04% (0.7038 => 0.7393, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.7710 => 0.8078, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.67% (0.5265 => 0.5511, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4062 => 0.4244, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (3.9660 => 4.1384, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.07% (0.2655 => 0.2763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2760 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.05% (0.2690 => 0.2799, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.92% (0.2937 => 0.3052, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (1.9828 => 2.0603, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2966 => 0.3081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.86% (0.3107 => 0.3227, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2761 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2726 => 0.2830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3489 => 0.3617, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.50% (13.8202 => 14.3036, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/matrix: 3.48% (0.2988 => 0.3092, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.33% (0.3756 => 0.3881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3192 => 0.3298, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (0.3293 => 0.3401, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.2193 => 1.2577, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.05% (0.4390 => 0.4524, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 2.97% (0.3868 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 2.96% (0.3578 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.4563 => 1.4979, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 2.82% (0.4003 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.78% (0.3914 => 0.4023, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.77% (0.3650 => 0.3751, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.76% (16.6129 => 17.0710, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 2.74% (0.3646 => 0.3746, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 2.69% (0.3789 => 0.3891, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.69% (1.3813 => 1.4184, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.67% (1.3819 => 1.4188, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9676, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 2.64% (0.3940 => 0.4044, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1153, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.56% (0.7506 => 0.7698, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.47% (1.1061 => 1.1334, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.45% (1.9270 => 1.9743, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2292 => 1.2568, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.2842 => 13.5819, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (7.2180 => 7.3701, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8310 => 0.8479, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.03% (3.6692 => 3.7438, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2206, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (6.5754 => 6.6872, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.69% (14.8535 => 15.1039, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (4.3801 => 4.4494, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.4433 => 4.5105, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.43% (0.8698 => 0.8822, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.32% (3.1889 => 3.2309, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6769, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1936, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9996 => 1.0790, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3971, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.03% (1.9199 => 1.9780, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5327, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7042, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9535, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.10% (0.3511 => 0.3367, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (6.2785 => 6.2033, std. dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: -1.04% (33.2944 => 32.9494, std. dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.58% (1.2308 => 1.1129, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.75% (20.3410 => 18.5612, std. dev.: 0.0689) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.8259 => 8.5705, std. dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9798, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8442, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2161, std. dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2426, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2170, std. dev.: 0.0308) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 20:37:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 22:37:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120630033717.28F182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1660?compare_to=1657&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1660, Order: 159479, Start Time: 2012-06-30 02:37:43, End Time: 2012-06-30 03:38:55 To: 1657, Order: 159476, Start Time: 2012-06-30 01:09:08, End Time: 2012-06-30 02:10:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 1 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (814 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.56% (13.0452 => 12.7114, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.61% (10.3673 => 12.7114, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.80% (1.1194 => 1.2627, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8931, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.47% (2.2022 => 2.3447, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3473 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 5.72% (0.3497 => 0.3697, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.70% (0.3543 => 0.3745, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/synchronized: 5.62% (0.3561 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.57% (0.3516 => 0.3712, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.36% (0.3694 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.27% (0.3927 => 0.4134, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.17% (0.3828 => 0.4026, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.15% (0.3886 => 0.4086, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (7.0540 => 7.3249, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.83% (0.4879 => 0.5066, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.59% (0.3177 => 0.3291, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.50% (10.4361 => 10.8012, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6030 => 0.6225, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.22% (0.5925 => 0.6116, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 3.15% (0.7433 => 0.7667, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.8172 => 0.8418, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7326 => 0.7513, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.89% (0.5569 => 0.5674, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.9449 => 5.0313, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (5.0018 => 5.0890, std. dev.: 0.0070) MultiSource/Applications/spiff/spiff: 1.58% (0.7835 => 0.7959, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (9.4845 => 9.6030, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.14% (4.2646 => 4.3131, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.10% (8.1363 => 8.2254, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7610, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7832, std. dev.: 0.0264) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5352, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2346, std. dev.: 0.0324) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1543, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6943, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6923, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5414, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.91% (22.1758 => 19.3122, std. dev.: 0.0480) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4539, std. dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.71% (3.8922 => 3.7868, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (0.8101 => 0.7950, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (7.9617 => 7.8503, std. dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: -1.09% (21.9371 => 21.6977, std. dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2373 => 1.1085, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.54% (19.9488 => 18.6435, std. dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9214, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6940, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 21:09:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 29 Jun 2012 23:09:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120630040949.0B2DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1661?compare_to=1659&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1661, Order: 159479, Start Time: 2012-06-30 03:14:55, End Time: 2012-06-30 04:11:27 To: 1659, Order: 159477, Start Time: 2012-06-30 01:51:14, End Time: 2012-06-30 02:47:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (741 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.82% (2.0176 => 2.2763, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5818 => 0.6179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5748 => 0.6099, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.59% (0.7061 => 0.7456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4328 => 0.4558, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3022 => 0.3174, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7038 => 0.7390, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.92% (1.3693 => 1.4367, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.7710 => 0.8069, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 4.65% (0.4062 => 0.4251, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.49% (0.2607 => 0.2724, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2596 => 0.2708, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.29% (0.2655 => 0.2769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.29% (1.9828 => 2.0678, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2628 => 0.2739, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.19% (3.9660 => 4.1323, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.2937 => 0.3060, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.2966 => 0.3090, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2761 => 0.2874, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.09% (0.3107 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3489 => 0.3627, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3149 => 0.3268, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.6959 => 0.7214, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.52% (0.3293 => 0.3409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3534 => 0.3653, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.35% (0.4390 => 0.4537, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.25% (13.8202 => 14.2697, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3868 => 0.3991, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 2.99% (0.3578 => 0.3685, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.2193 => 1.2557, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 2.85% (0.4003 => 0.4117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 2.81% (0.3914 => 0.4024, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.78% (1.3245 => 1.3613, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.4563 => 1.4958, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (3.8646 => 3.9670, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 2.64% (0.3789 => 0.3889, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.63% (16.6129 => 17.0505, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.50% (0.7506 => 0.7694, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1111, std. dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4379 => 0.4487, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.47% (1.2292 => 1.2595, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.34% (1.9270 => 1.9721, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.17% (1.3813 => 1.4113, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4107, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (13.2842 => 13.5516, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.97% (7.2180 => 7.3603, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7363, std. dev.: 0.0112) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2165, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.62% (14.8535 => 15.0934, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.58% (0.8698 => 0.8835, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.54% (6.5754 => 6.6765, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.47% (4.3801 => 4.4443, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (4.4433 => 4.5043, std. dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.14% (3.1889 => 3.2252, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1333 => 1.1452, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1876, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7304, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (3.6469 => 3.7012, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.68% (0.4657 => 0.3880, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9087, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.13% (0.3511 => 0.3331, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.6576 => 0.6447, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.2785 => 6.1946, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2308 => 1.0991, std. dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5930, std. dev.: 0.0498) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.98% (1.3780 => 1.3232, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5925, std. dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9825, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8441, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2134, std. dev.: 0.0374) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jun 29 22:04:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 00:04:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120630050449.6380F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/1662?compare_to=1658&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1662, Order: 159479, Start Time: 2012-06-30 02:50:52, End Time: 2012-06-30 05:06:27 To: 1658, Order: 159474, Start Time: 2012-06-30 00:08:07, End Time: 2012-06-30 02:23:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (28 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (864 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.68% (0.3792 => 0.4614, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions-2: 7.31% (0.3446 => 0.3698, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.27% (0.3496 => 0.3750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3465 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.22% (0.3488 => 0.3740, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 7.15% (0.3469 => 0.3717, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3442 => 0.3688, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3460 => 0.3707, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3643 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.85% (0.3650 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.66% (0.3724 => 0.3972, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.48% (0.5826 => 0.6087, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.18% (0.5889 => 0.6135, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 3.33% (0.7171 => 0.7410, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.63% (0.5900 => 0.6055, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (0.5026 => 0.5157, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (1.6211 => 1.6630, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.51% (0.4029 => 0.4130, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (3.5627 => 3.6452, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (0.4361 => 0.4461, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.04% (2.0673 => 2.1094, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.93% (0.9909 => 1.0100, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.87% (1.3152 => 1.3398, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.79% (4.2109 => 4.2863, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.31% (1.9694 => 1.9952, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.29% (0.9697 => 0.9822, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (1.9966 => 2.0212, std. dev.: 0.0070) MultiSource/Applications/d/make_dparser: 1.01% (1.0781 => 1.0890, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.84% (2.4764 => 2.3812, std. dev.: 0.0309) MultiSource/Applications/kimwitu++/kc: -2.68% (11.9555 => 11.6351, std. dev.: 0.0061) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 14:52:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 16:52:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120630215233.472A82A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1663?compare_to=1661&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1663, Order: 159491, Start Time: 2012-06-30 20:57:31, End Time: 2012-06-30 21:54:12 To: 1661, Order: 159479, Start Time: 2012-06-30 03:14:55, End Time: 2012-06-30 04:11:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2766, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.75% (0.5818 => 0.6211, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5748 => 0.6126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7061 => 0.7488, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.13% (1.3693 => 1.4395, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.12% (0.7038 => 0.7398, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.4062 => 0.4258, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.79% (0.5265 => 0.5517, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.79% (0.7710 => 0.8079, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 4.76% (0.2607 => 0.2731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.63% (0.2765 => 0.2893, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.60% (3.9660 => 4.1483, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.38% (1.9828 => 2.0697, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.20% (0.2761 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3149 => 0.3280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3899 => 0.4060, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.11% (0.3578 => 0.3725, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.10% (0.3489 => 0.3632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.06% (0.4016 => 0.4179, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.05% (0.6959 => 0.7241, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 4.01% (0.3789 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.89% (0.3646 => 0.3788, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.89% (0.3601 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.86% (0.3914 => 0.4065, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.85% (0.4003 => 0.4157, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 3.82% (0.3663 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.75% (0.3650 => 0.3787, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3293 => 0.3416, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 3.73% (0.3623 => 0.3758, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.70% (13.8202 => 14.3320, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/property: 3.65% (0.3940 => 0.4084, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.54% (0.3534 => 0.3659, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.3756 => 0.3888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.2193 => 1.2601, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.4563 => 1.5022, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.3245 => 1.3651, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4379 => 0.4511, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1364 => 1.1699, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.0990, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9728, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 2.76% (1.2292 => 1.2631, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (4.9865 => 5.1231, std. dev.: 0.0208) MultiSource/Applications/Burg/burg: 2.73% (1.1061 => 1.1363, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 2.72% (0.7506 => 0.7710, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.64% (1.9270 => 1.9778, std. dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.56% (1.3813 => 1.4167, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4158, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (7.2180 => 7.3941, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5845, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.25% (3.6692 => 3.7517, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.13% (0.7460 => 0.7619, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.12% (14.8535 => 15.1680, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.6135 => 0.6257, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2220, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.92% (6.5754 => 6.7019, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8698 => 0.8865, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4624, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (4.4433 => 4.5219, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1333 => 1.1490, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.13% (14.5298 => 14.6939, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.86% (1.8175 => 2.2694, std. dev.: 0.0455) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3953, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7304, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7042, std. dev.: 0.0055) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.82% (0.4657 => 0.3967, std. dev.: 0.0152) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9653, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.98% (0.3511 => 0.3336, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.50% (0.9108 => 0.8971, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.75% (20.3410 => 18.5603, std. dev.: 0.0271) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5881, std. dev.: 0.0289) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9792, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8432, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.22% (0.9692 => 0.9574, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2536, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2266, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 14:56:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 16:56:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120630215652.85D622A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1664?compare_to=1660&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1664, Order: 159491, Start Time: 2012-06-30 20:57:31, End Time: 2012-06-30 21:58:32 To: 1660, Order: 159479, Start Time: 2012-06-30 02:37:43, End Time: 2012-06-30 03:38:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (39 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 872 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.65% (12.7114 => 12.9212, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -2.72% (0.3897 => 0.3791, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.63% (10.3673 => 12.9212, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.58% (1.1194 => 1.2602, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8899, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.00% (2.2022 => 2.3564, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 6.77% (0.3473 => 0.3708, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3516 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.52% (0.3543 => 0.3774, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.52% (0.3497 => 0.3725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3543 => 0.3773, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.43% (0.3561 => 0.3790, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3694 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.06% (0.3828 => 0.4060, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.02% (0.3886 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3927 => 0.4161, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (7.0540 => 7.3329, std. dev.: 0.0096) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5925 => 0.6149, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.77% (0.4879 => 0.5063, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.67% (0.6030 => 0.6251, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (10.4361 => 10.8074, std. dev.: 0.0178) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.49% (0.3177 => 0.3288, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7433 => 0.7659, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7326 => 0.7539, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.8172 => 0.8339, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.9449 => 5.0356, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.81% (0.5569 => 0.5670, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (5.0018 => 5.0891, std. dev.: 0.0095) MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (9.4845 => 9.6108, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.22% (4.2646 => 4.3167, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.22% (2.0665 => 2.0917, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (8.1363 => 8.2345, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8082, std. dev.: 0.0293) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6881, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2300, std. dev.: 0.0190) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1504, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7012, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6932, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5372, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -12.89% (22.1758 => 19.3184, std. dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4444, std. dev.: 0.0396) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.84% (3.8922 => 3.7818, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.73% (0.8101 => 0.7961, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (7.9617 => 7.8424, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2373 => 1.1118, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5500, std. dev.: 0.0847) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9171, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6878, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 16:13:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 18:13:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120630231352.E96C92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1665?compare_to=1662&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1665, Order: 159491, Start Time: 2012-06-30 20:57:51, End Time: 2012-06-30 23:13:46 To: 1662, Order: 159479, Start Time: 2012-06-30 02:50:52, End Time: 2012-06-30 05:06:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.40% (2.0401 => 2.1299, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.36% (0.3465 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.27% (0.3496 => 0.3750, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3446 => 0.3695, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3442 => 0.3690, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.17% (0.3460 => 0.3708, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.15% (0.3469 => 0.3717, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3488 => 0.3736, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3643 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.82% (0.3650 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.66% (0.3724 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.24% (0.5826 => 0.6073, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.94% (0.5889 => 0.6121, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.64% (0.7171 => 0.7432, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.5900 => 0.6078, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (0.5026 => 0.5169, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.84% (1.6211 => 1.6671, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.53% (0.4029 => 0.4131, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (0.4361 => 0.4469, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (3.5627 => 3.6505, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.21% (0.9909 => 1.0128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (2.0673 => 2.1118, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (1.3152 => 1.3411, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 1.76% (4.2109 => 4.2849, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 1.45% (0.9697 => 0.9838, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (1.9694 => 1.9969, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (1.9966 => 2.0244, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (2.7292 => 2.7586, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 1.06% (1.8794 => 1.8993, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.02% (1.0781 => 1.0891, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.30% (2.0820 => 2.1299, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.96% (2.4764 => 2.3783, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -2.61% (11.9555 => 11.6438, std. dev.: 0.0043) Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 16:18:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 18:18:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120630231808.CBC472A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1666?compare_to=1663&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1666, Order: 159494, Start Time: 2012-06-30 22:21:22, End Time: 2012-06-30 23:18:02 To: 1663, Order: 159491, Start Time: 2012-06-30 20:57:31, End Time: 2012-06-30 21:54:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2799, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 7.13% (0.5818 => 0.6233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.96% (0.5748 => 0.6148, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.39% (0.7061 => 0.7512, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4328 => 0.4584, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.54% (0.1986 => 0.2096, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.29% (1.3693 => 1.4417, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7038 => 0.7409, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.7710 => 0.8109, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.00% (0.5265 => 0.5528, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.71% (3.9660 => 4.1527, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.64% (1.9828 => 2.0748, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.64% (0.3578 => 0.3744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.53% (0.3646 => 0.3811, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.50% (0.3663 => 0.3828, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.41% (0.3789 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.39% (0.3601 => 0.3759, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.38% (0.3107 => 0.3243, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 4.32% (0.3914 => 0.4083, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.30% (0.3650 => 0.3807, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3489 => 0.3639, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.30% (0.4003 => 0.4175, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.20% (0.3623 => 0.3775, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.19% (0.3940 => 0.4105, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.15% (0.6959 => 0.7248, std. dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 3.91% (13.8202 => 14.3604, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9199 => 0.9534, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3868 => 0.4007, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5577 => 0.5767, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.2193 => 1.2603, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5037, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4379 => 0.4520, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3668, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4244, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9812, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (1.3813 => 1.4227, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1063, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 2.93% (1.1061 => 1.1385, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.87% (1.9270 => 1.9824, std. dev.: 0.0123) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (4.9865 => 5.1277, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.82% (1.2292 => 1.2639, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (7.2180 => 7.3999, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (3.6692 => 3.7574, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.2842 => 13.6013, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.27% (2.1791 => 2.2285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.05% (14.8535 => 15.1584, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.5754 => 6.7097, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4666, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (4.4433 => 4.5255, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.70% (3.1889 => 3.2430, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1333 => 1.1508, std. dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.5298 => 14.7116, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1932, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7200, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6469 => 3.7156, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.47% (0.4657 => 0.3983, std. dev.: 0.0163) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9982, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.81% (0.3511 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.77% (20.3410 => 18.5573, std. dev.: 0.1019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.52% (1.3780 => 1.3157, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5901, std. dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2518, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.51% (3.0263 => 2.9806, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2106, std. dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8442, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 16:26:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 18:26:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120630232639.502D62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1667?compare_to=1664&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1667, Order: 159494, Start Time: 2012-06-30 22:25:37, End Time: 2012-06-30 23:26:33 To: 1664, Order: 159491, Start Time: 2012-06-30 20:57:31, End Time: 2012-06-30 21:58:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (42 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (813 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.44% (12.9212 => 13.2359, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.67% (10.3673 => 13.2359, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.60% (1.1194 => 1.2604, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.85% (1.7609 => 1.8991, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.09% (2.2022 => 2.3583, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.00% (0.3516 => 0.3762, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 6.92% (0.3543 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.89% (0.3543 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3561 => 0.3806, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 6.71% (0.3694 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.45% (0.3828 => 0.4075, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.41% (0.3886 => 0.4135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3927 => 0.4176, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.13% (7.0540 => 7.3454, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.90% (10.4361 => 10.8432, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5925 => 0.6149, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.78% (0.3177 => 0.3297, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 3.75% (0.6030 => 0.6256, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.10% (0.7326 => 0.7553, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (0.7433 => 0.7640, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.8172 => 0.8334, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (5.0018 => 5.0990, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.9449 => 5.0378, std. dev.: 0.0053) MultiSource/Applications/spiff/spiff: 1.63% (0.7835 => 0.7963, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (9.4845 => 9.6282, std. dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.37% (8.1363 => 8.2477, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (4.2646 => 4.3225, std. dev.: 0.0145) MultiSource/Applications/hbd/hbd: 1.09% (1.5603 => 1.5773, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.00% (5.7591 => 5.8169, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7565, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.62% (26.0924 => 26.7759, std. dev.: 0.0350) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1620, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6992, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.97% (5.3526 => 3.6951, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.53% (2.9384 => 2.5409, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: -12.80% (22.1758 => 19.3370, std. dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4794, std. dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.66% (3.8922 => 3.7885, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.70% (0.8101 => 0.7963, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (7.9617 => 7.8787, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5558, std. dev.: 0.0883) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9140, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6848, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 17:41:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 19:41:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701004155.6165C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1668?compare_to=1666&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1668, Order: 159497, Start Time: 2012-06-30 23:45:10, End Time: 2012-07-01 00:41:50 To: 1666, Order: 159494, Start Time: 2012-06-30 22:21:22, End Time: 2012-06-30 23:18:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.09% (2.0176 => 2.2817, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5818 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.10% (0.5748 => 0.6156, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.39% (0.7061 => 0.7512, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.84% (1.3693 => 1.4492, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.7038 => 0.7423, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4062 => 0.4272, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.89% (0.7710 => 0.8087, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5265 => 0.5515, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0764, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.67% (0.3489 => 0.3652, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2988 => 0.3122, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.37% (3.9660 => 4.1392, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 4.30% (0.3578 => 0.3732, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 4.06% (0.3914 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.06% (0.3646 => 0.3794, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 4.03% (0.3623 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.03% (0.3601 => 0.3746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.97% (0.3650 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.95% (0.4003 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.93% (0.3789 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.90% (0.3663 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.86% (0.3940 => 0.4092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.6959 => 0.7225, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3534 => 0.3665, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.68% (13.8202 => 14.3292, std. dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4390 => 0.4549, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.57% (1.2292 => 1.2731, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.2193 => 1.2577, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0926, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (3.8646 => 3.9759, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.4563 => 1.4979, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.80% (1.3245 => 1.3616, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (1.1364 => 1.1680, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3755 => 0.3859, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.72% (0.7506 => 0.7710, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (4.9865 => 5.1177, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (1.3819 => 1.4182, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.60% (1.3813 => 1.4172, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9765, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.55% (1.1061 => 1.1343, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.18% (7.2180 => 7.3750, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (13.2842 => 13.5716, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.96% (2.1791 => 2.2218, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8310 => 0.8470, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (0.8698 => 0.8855, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (3.6692 => 3.7311, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6823, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (4.3801 => 4.4504, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5114, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.53% (14.8535 => 15.0804, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2285, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1927, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4023, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7234, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.77% (1.9144 => 1.9865, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9231, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.91% (1.4298 => 1.4571, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7001, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9346, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3511 => 0.3352, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.01% (0.9108 => 0.8925, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.2785 => 6.1970, std. dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2308 => 1.1051, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5764, std. dev.: 0.0425) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.13% (1.3780 => 1.3211, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5825, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9834, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8436, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2196, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2434, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2559, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2247, std. dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 17:54:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 19:54:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701005443.E89722A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1669?compare_to=1667&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1669, Order: 159497, Start Time: 2012-06-30 23:53:41, End Time: 2012-07-01 00:54:38 To: 1667, Order: 159494, Start Time: 2012-06-30 22:25:37, End Time: 2012-06-30 23:26:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (42 on baseline) Performance Improvements: 1 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.43% (13.2359 => 13.0469, std. dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.85% (10.3673 => 13.0469, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.79% (1.1194 => 1.2626, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3473 => 0.3739, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.39% (0.3543 => 0.3805, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 7.39% (0.3561 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3543 => 0.3804, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.37% (0.3516 => 0.3775, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.17% (0.3694 => 0.3959, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3828 => 0.4089, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.74% (0.3886 => 0.4148, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.70% (0.3927 => 0.4190, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.39% (2.2022 => 2.3429, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.41% (0.6030 => 0.6296, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.5925 => 0.6185, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (7.0540 => 7.3281, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.69% (0.4879 => 0.5059, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.66% (0.7326 => 0.7594, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.59% (0.3177 => 0.3291, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.4361 => 10.8004, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.95% (0.7433 => 0.7652, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.21% (0.5569 => 0.5692, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.8172 => 0.8343, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 1.70% (0.7835 => 0.7968, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (5.0018 => 5.0846, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.9449 => 5.0257, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.1363 => 8.2520, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.31% (4.2646 => 4.3205, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.27% (2.0665 => 2.0927, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (9.4845 => 9.5988, std. dev.: 0.0052) MultiSource/Applications/treecc/treecc: 1.11% (2.0273 => 2.0499, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.07% (1.1642 => 1.1767, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7578, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8082, std. dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6878, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1583, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6943, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6891, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5427, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.82% (22.1758 => 19.3329, std. dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4523, std. dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.06% (3.8922 => 3.7732, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.69% (0.8101 => 0.7964, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -1.18% (21.9371 => 21.6776, std. dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (7.9617 => 7.8711, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1161, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.55% (19.9488 => 18.6424, std. dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9208, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6852, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0817, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 18:56:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 20:56:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701015628.D1FC22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1670?compare_to=1665&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1670, Order: 159497, Start Time: 2012-06-30 23:40:58, End Time: 2012-07-01 01:56:24 To: 1665, Order: 159491, Start Time: 2012-06-30 20:57:51, End Time: 2012-06-30 23:13:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (25 on baseline) Performance Improvements: 1 (2 on baseline) Unchanged Tests: 892 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.07% (0.2170 => 0.2280, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.80% (0.7432 => 0.7298, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.82% (0.3446 => 0.3681, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.81% (0.3465 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3460 => 0.3695, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3496 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3442 => 0.3672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.65% (0.3488 => 0.3720, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3643 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3469 => 0.3698, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.49% (0.3792 => 0.4038, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 6.36% (0.3650 => 0.3882, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.23% (0.3724 => 0.3956, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (0.5026 => 0.5173, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.5889 => 0.6054, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 2.48% (0.4029 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (1.6211 => 1.6579, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.18% (0.4994 => 0.5103, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (3.5627 => 3.6392, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.77% (0.7171 => 0.7298, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.72% (1.3152 => 1.3378, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 1.70% (4.2109 => 4.2825, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.47% (2.0673 => 2.0976, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (2.7292 => 2.7632, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (1.9694 => 1.9906, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.45% (0.2122 => 0.2280, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.22% (2.4764 => 2.3720, std. dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: -2.99% (11.9555 => 11.5980, std. dev.: 0.0036) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 19:12:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 21:12:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701021250.E894F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1671?compare_to=1668&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1671, Order: 159499, Start Time: 2012-07-01 01:16:03, End Time: 2012-07-01 02:12:46 To: 1668, Order: 159497, Start Time: 2012-06-30 23:45:10, End Time: 2012-07-01 00:41:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.17% (1.4023 => 1.4187, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.19% (0.4124 => 0.3910, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2823, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5818 => 0.6244, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.10% (0.5748 => 0.6156, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.42% (0.7061 => 0.7514, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.84% (1.3693 => 1.4492, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.7038 => 0.7433, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.07% (0.4062 => 0.4268, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.7710 => 0.8095, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.84% (0.5265 => 0.5520, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.78% (1.9828 => 2.0775, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1418, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3580 => 0.3737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.25% (0.3578 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.15% (0.3663 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.14% (0.3789 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.14% (0.3646 => 0.3797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 4.11% (0.3601 => 0.3749, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.09% (0.3914 => 0.4074, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 4.05% (0.4003 => 0.4165, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.92% (0.3623 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.92% (0.3650 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.88% (0.3940 => 0.4093, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.6959 => 0.7225, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.68% (13.8202 => 14.3286, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4390 => 0.4550, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9199 => 0.9524, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.2193 => 1.2588, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (1.4563 => 1.5002, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1052, std. dev.: 0.0126) MultiSource/Applications/hexxagon/hexxagon: 2.95% (1.2292 => 1.2655, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 2.95% (3.8646 => 3.9785, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3622, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.70% (1.3819 => 1.4192, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1207, std. dev.: 0.0069) MultiSource/Applications/treecc/treecc: 2.68% (1.9270 => 1.9786, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.3813 => 1.4180, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (0.4379 => 0.4494, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.0594 => 1.0863, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.45% (0.7460 => 0.7643, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (7.2180 => 7.3814, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2273, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5737, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (4.3801 => 4.4641, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.8698 => 0.8856, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (3.6692 => 3.7330, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.69% (6.5754 => 6.6865, std. dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0920, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.4433 => 4.5118, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.46% (3.1889 => 3.2353, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.75% (1.8175 => 2.3037, std. dev.: 0.0354) SingleSource/Benchmarks/Misc/mandel-2: 9.15% (1.2998 => 1.4187, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7301, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7108, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9595, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9367, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.39% (0.3511 => 0.3357, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (6.2785 => 6.2016, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1047, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (20.3410 => 18.5926, std. dev.: 0.0270) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6015, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5114, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9799, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8450, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.10% (7.3305 => 7.2502, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2344, std. dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 19:22:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 21:22:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701022259.7FE982A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1672?compare_to=1669&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1672, Order: 159499, Start Time: 2012-07-01 01:21:53, End Time: 2012-07-01 02:22:54 To: 1669, Order: 159497, Start Time: 2012-06-30 23:53:41, End Time: 2012-07-01 00:54:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (813 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.90% (10.3673 => 13.0527, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.85% (1.1194 => 1.2632, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.46% (0.3497 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3543 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3516 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.33% (0.3561 => 0.3822, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (1.7609 => 1.8894, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3828 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.77% (0.3886 => 0.4149, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.3927 => 0.4191, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.33% (2.2022 => 2.3415, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 4.46% (0.6030 => 0.6299, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.5925 => 0.6185, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (7.0540 => 7.3309, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.67% (0.4879 => 0.5058, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.65% (0.3177 => 0.3293, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7326 => 0.7592, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.4361 => 10.7960, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7433 => 0.7659, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.8172 => 0.8351, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.9449 => 5.0281, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: 1.66% (0.7835 => 0.7965, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (5.0018 => 5.0847, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.1363 => 8.2510, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (4.2646 => 4.3220, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (2.0665 => 2.0914, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (9.4845 => 9.5978, std. dev.: 0.0100) MultiSource/Applications/treecc/treecc: 1.17% (2.0273 => 2.0511, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.73% (26.0924 => 26.8049, std. dev.: 0.0315) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2486, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1593, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.38% (5.3855 => 3.6953, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6886, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5435, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.84% (22.1758 => 19.3287, std. dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4558, std. dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.08% (3.8922 => 3.7725, std. dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.67% (0.8101 => 0.7966, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.23% (21.9371 => 21.6665, std. dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (7.9617 => 7.8688, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2373 => 1.1055, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.17% (19.9488 => 18.5186, std. dev.: 0.0865) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9181, std. dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6897, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 20:38:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 22:38:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701033830.CC8382A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1673?compare_to=1671&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1673, Order: 159500, Start Time: 2012-07-01 02:41:45, End Time: 2012-07-01 03:38:24 To: 1671, Order: 159499, Start Time: 2012-07-01 01:16:03, End Time: 2012-07-01 02:12:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (2.0176 => 2.2870, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5818 => 0.6244, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.98% (0.5748 => 0.6149, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.49% (0.7061 => 0.7519, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (0.7038 => 0.7412, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 5.29% (1.3693 => 1.4417, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.16% (0.3022 => 0.3178, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5265 => 0.5524, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.7710 => 0.8085, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 4.83% (0.2628 => 0.2755, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.64% (0.2696 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.58% (1.9828 => 2.0736, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (3.9660 => 4.1471, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3489 => 0.3637, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3149 => 0.3282, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 4.22% (0.3578 => 0.3729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.01% (0.3914 => 0.4071, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 4.00% (0.3646 => 0.3792, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 4.00% (0.3601 => 0.3745, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 3.99% (0.3789 => 0.3940, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 3.97% (0.4003 => 0.4162, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 3.96% (0.3663 => 0.3808, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.95% (0.6959 => 0.7234, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.95% (0.3650 => 0.3794, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 3.86% (0.3623 => 0.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.78% (0.3940 => 0.4089, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3534 => 0.3665, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3245, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9199 => 0.9529, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.3756 => 0.3889, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.2193 => 1.2620, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.44% (0.3868 => 0.4001, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.4563 => 1.5023, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5577 => 0.5751, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.1364 => 1.1705, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (3.8646 => 3.9802, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.88% (0.7506 => 0.7722, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.85% (16.6129 => 17.0871, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.2292 => 1.2635, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.78% (4.9865 => 5.1249, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.77% (1.3813 => 1.4196, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (13.2842 => 13.6516, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4379 => 0.4500, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.71% (1.1061 => 1.1361, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.68% (1.9270 => 1.9787, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (1.3819 => 1.4183, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (7.2180 => 7.3957, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.10% (2.1791 => 2.2249, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (3.6692 => 3.7410, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8698 => 0.8864, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.90% (14.8535 => 15.1359, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.86% (6.5754 => 6.6979, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.74% (4.3801 => 4.4562, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.4433 => 4.5183, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 1.51% (3.1889 => 3.2372, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1333 => 1.1492, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.26% (14.5298 => 14.7127, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0520) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3894, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.86% (7.4271 => 7.7135, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9776, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7003, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std. dev.: 0.0242) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9564, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.10% (0.3511 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.8818 => 0.8561, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2308 => 1.1066, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (20.3410 => 18.5982, std. dev.: 0.0426) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3170, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.50% (3.0263 => 2.9810, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8434, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2454, std. dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 20:52:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 22:52:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701035251.C22F62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1674?compare_to=1672&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1674, Order: 159502, Start Time: 2012-07-01 02:51:36, End Time: 2012-07-01 03:52:45 To: 1672, Order: 159499, Start Time: 2012-07-01 01:21:53, End Time: 2012-07-01 02:22:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.98% (10.3673 => 13.0603, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.76% (1.1194 => 1.2622, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.06% (1.7609 => 1.8852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.97% (0.3543 => 0.3790, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.92% (0.3543 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3561 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.37% (2.2022 => 2.3424, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.30% (0.3828 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.26% (0.3927 => 0.4173, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.90% (0.3177 => 0.3301, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (7.0540 => 7.3160, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 3.56% (0.5925 => 0.6136, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.4879 => 0.5051, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (10.4361 => 10.7695, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 2.74% (0.7326 => 0.7527, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (0.7433 => 0.7632, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.8172 => 0.8351, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.87% (0.5569 => 0.5673, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (4.9449 => 5.0183, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.48% (5.0018 => 5.0756, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (8.1363 => 8.2279, std. dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (4.2646 => 4.3080, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0874, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7457, std. dev.: 0.0076) MultiSource/Applications/lua/lua: 2.76% (26.0924 => 26.8116, std. dev.: 0.0360) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.57% (9.1159 => 9.2588, std. dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6887, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1541, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6872, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6821, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5467, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -12.99% (22.1758 => 19.2957, std. dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4643, std. dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.22% (3.8922 => 3.7670, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.81% (0.8101 => 0.7954, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (7.9617 => 7.8292, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: -1.33% (21.9371 => 21.6456, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2373 => 1.1116, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.63% (19.9488 => 18.6267, std. dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9199, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.58% (32.5116 => 31.6735, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0863, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 21:38:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 30 Jun 2012 23:38:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701043857.C71002A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1675?compare_to=1670&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1675, Order: 159499, Start Time: 2012-07-01 02:23:31, End Time: 2012-07-01 04:38:52 To: 1670, Order: 159497, Start Time: 2012-06-30 23:40:58, End Time: 2012-07-01 01:56:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (22 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (870 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.85% (0.3446 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.81% (0.3465 => 0.3701, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.75% (0.3496 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3442 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3460 => 0.3692, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.68% (0.3488 => 0.3721, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3469 => 0.3700, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.62% (0.3643 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.41% (0.3650 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.15% (0.3724 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.09% (0.5826 => 0.6006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.80% (0.5889 => 0.6054, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (0.5026 => 0.5162, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.5900 => 0.6053, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (1.6211 => 1.6579, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (3.5627 => 3.6361, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (1.3152 => 1.3383, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7171 => 0.7292, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.49% (2.0673 => 2.0980, std. dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: 1.45% (4.2109 => 4.2721, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 1.37% (0.9909 => 1.0045, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (2.7292 => 2.7577, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.24% (2.4764 => 2.3713, std. dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: -2.95% (11.9555 => 11.6026, std. dev.: 0.0074) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 22:02:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 00:02:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701050213.08C5C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1676?compare_to=1673&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1676, Order: 159503, Start Time: 2012-07-01 04:05:31, End Time: 2012-07-01 05:02:06 To: 1673, Order: 159500, Start Time: 2012-07-01 02:41:45, End Time: 2012-07-01 03:38:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2838, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.5818 => 0.6252, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.25% (0.5748 => 0.6165, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7061 => 0.7544, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2781 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.39% (0.1986 => 0.2093, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7038 => 0.7408, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.7710 => 0.8105, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.10% (1.3693 => 1.4391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (1.9828 => 2.0806, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.81% (0.5265 => 0.5518, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.61% (3.9660 => 4.1489, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.25% (0.3623 => 0.3777, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.25% (0.3601 => 0.3754, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.17% (0.4003 => 0.4170, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 4.15% (0.3663 => 0.3815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.14% (0.3650 => 0.3801, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.12% (0.3789 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.11% (0.3940 => 0.4102, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.6959 => 0.7242, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3252, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.9199 => 0.9531, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.2193 => 1.2599, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5577 => 0.5760, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2292 => 1.2669, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.4563 => 1.5008, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1356, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.1364 => 1.1703, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1059, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3245 => 1.3629, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (3.8646 => 3.9766, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.80% (0.7506 => 0.7716, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.74% (0.4379 => 0.4499, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.70% (1.9270 => 1.9791, std. dev.: 0.0133) MultiSource/Applications/Burg/burg: 2.70% (1.1061 => 1.1360, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.3819 => 1.4180, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.3813 => 1.4151, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (7.2180 => 7.3924, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.2842 => 13.6051, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.29% (0.7460 => 0.7631, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.10% (2.1791 => 2.2249, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8310 => 0.8482, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7376, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.81% (14.8535 => 15.1223, std. dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 1.76% (6.5754 => 6.6912, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.3801 => 4.4525, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.4433 => 4.5121, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 1.41% (3.1889 => 3.2339, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1482, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.07% (14.5298 => 14.6855, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2723, std. dev.: 0.0242) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.87% (1.2998 => 1.3891, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7236, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9186, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6469 => 3.7110, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.16% (0.4657 => 0.3951, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9832, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.56% (0.3511 => 0.3351, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.91% (0.9108 => 0.8934, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1037, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.21% (20.3410 => 18.4671, std. dev.: 0.1113) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5965, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9786, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8441, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2552, std. dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jun 30 22:21:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 00:21:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701052101.4FE612A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1677?compare_to=1674&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1677, Order: 159503, Start Time: 2012-07-01 04:19:53, End Time: 2012-07-01 05:20:55 To: 1674, Order: 159502, Start Time: 2012-07-01 02:51:36, End Time: 2012-07-01 03:52:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (820 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.61% (10.3673 => 13.1256, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.62% (1.1194 => 1.2607, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3497 => 0.3743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3561 => 0.3809, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.95% (1.7609 => 1.8832, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.88% (0.3516 => 0.3758, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.83% (0.3543 => 0.3785, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.32% (0.3828 => 0.4070, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 6.23% (0.3886 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.21% (0.3927 => 0.4171, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.02% (2.2022 => 2.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (7.0540 => 7.2961, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.30% (0.4879 => 0.5040, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6030 => 0.6225, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.18% (0.3177 => 0.3278, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (10.4361 => 10.7470, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7433 => 0.7624, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.47% (0.8172 => 0.8374, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 2.44% (0.7326 => 0.7505, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.03% (0.5569 => 0.5682, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.48% (0.7835 => 0.7951, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.44% (4.9449 => 5.0161, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (5.0018 => 5.0735, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (8.1363 => 8.2276, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7522, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 2.69% (26.0924 => 26.7952, std. dev.: 0.0572) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2448, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1559, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6799, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.39% (5.3526 => 3.6725, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5447, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -13.03% (22.1758 => 19.2861, std. dev.: 0.0173) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4871, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.31% (3.8922 => 3.7632, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.89% (0.8101 => 0.7948, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.87% (7.9617 => 7.8131, std. dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: -1.39% (21.9371 => 21.6328, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2373 => 1.1133, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.65% (19.9488 => 18.4234, std. dev.: 0.1384) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9232, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6887, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: